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© Method and system for synchronization of an auxiliary sound source which may contain multiple 
language channels to motion picture film, video tape, or other picture source containing a sound 
track. 



© The method of synchronizing with a first audio 
signal (21) of an audio message a second audio 
signal (19) of the audio message at a higher quality 
and wherein said first audio signal was derived from 
a master recording, comprises the steps of: 
causing said second audio signal (19) to be derived 
from said master recording or from a high quality 
CNJ duplicate of the master recording; and 
*^ correlating (17) intrinsic characteristics of said audio 
IX^ message of said second audio signal with intrinsic 
lf3 characteristics of said audio message of said first 
*™ audio signal for synchronizing (23) said second 
CM audio signal with said first audio signal (21). 
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METHOD AND SYSTEM FOR SYNCHRONIZATION OF AN AUXILIARY SOUND SOURCE WHICH MAY 
CONTAIN MULTIPLE LANGUAGE CHANNELS TO MOTION PICTURE FILM, VIDEO TAPE, OR OTHER 

PICTURE SOURCE CONTAINING A SOUND TRACK 



The present invention is in the field of sound 
synchronization, and more particularly this inven- 
tion relates to a method and system for the syn- 
chronizing of a higher quality sound source with 
another sound source of the same information con- 5 
tent. This method and system are typified by an 
auxiliary digital sound source being synchronized, 
i.e. locked in time, to an analog sound track of a 
cinema film as the motion picture is being shown, 
or are typified by such an auxiliary digital sound io 
source being synchronized to a conventional audio 
portion of a video tape as the video tape program 
is being viewed. 

The higher quality sound source contains a first 
(or "prime") sound track wherein the language is 
spoken is identical (except for higher sound quality) 
to the language spoken in the ordinary quality 
sound track of the same information content in the 
other source. This prime track is used for synchro- 
nization with the other source. In addition, the high- 20 
er quality sound source may contain one or more 
translation sound tracks, each of which is always 
simultaneously running in synchronism with the 
prime sound track. In each such translation sound 
track the spoken language is different from the 25 
language in the prime sound track and is different 
from the language in each of the other translation 
sound tracks. Each such, translation track provides 
an appropriate translation of the prime spoken lan- 
guage. Thus by virtue of synchronizing the prime 30 
higher quality sound track with the ordinary sound 
track of the same informational content, each of the 
simultaneously running translation sound tracks is 
also inherently synchronized with the ordinary 
sound track. Therefore, advantageously, each of 35 
the translation sound tracks is available to be se- 
lected for listening by a cinema audience or by 
segments of the cinema audience sitting in pre- 
selected seating areas having listening devices as- 
signed to respective languages (or selected by an 40 
individual viewer in a theater or at home desiring to 
hear a particular language furnished by a particular 
one of the available synchronized translation sound 
tracks). 

At the present time, for the case of motion 45 
pictures, there are various techniques being used 
to permit the use of auxiliary (digital) audio sound 
sources for motion pictures. They require the prep- 
aration of a special film print which contains a 
unique marker code in place of the standard optical 50 
audio track. The special release print film, along 
with the digital audio recording and special 
playback equipment, is supplied to theaters for 



digital playback. Theaters with regular projectors 
must receive the standard film instead and cannot 
utilize the higher quality digital audio sound sour- 
ces. 

One reason why a unique marker code is re- 
quired (rather than merely using the passage of 
time for synchronization) is that the motion picture 
film itself during its repeated handling and showing 
is subject to breakage and consequent film splic- 
ing. When the film is spliced, one or more frames 
of the film become lost at the splice depending 
upon whether the breakage was straight across the 
film or was a diagonal tear extending obliquely 
through more than one frame of the motion picture. 
This loss of one or more frames causes the motion 
picture and the sound track on the film to become 
shortened in physical length. Thus, there is a sud- 
den forward "jump" in the motion picture which 
momentarily loses synchronism with the sound 
track when the splice passes through the motion 
picture projector aperture. The synchronism is re- 
gained when the splice passes through the sound 
transducer. This momentary loss of synchronism is 
due to the physical film path distance between the 
projector aperture and the sound transducer as is 
conventional in motion picture projectors. The 
sound track is conventionally offset along the 
length of the film from the specific frames to which 
the sound track relates by an "offset distance" 
equal to the length of the normal film path distance 
in a projector between the optical aperture and the 
sound track transducer. The method and system of 
the present invention do not remove that momen- 
tary loss of synchronism caused by the interaction 
of a film splice with the physical film path distance 
between the optical aperture and the sound trans- 
ducer.. 

There are other reasons why a marker code is 
used on the motion picture film for synchronization 
of an auxiliary sound source with the film. These 
other reasons include start-up, unexpected stop- 
page due to variety of possible causes and speed 
creepage of either the motion picture projector or 
of the auxiliary sound source. 

In the case of video tape, there are many 
synchronizing systems available which use special 
marker coding systems. However, there is no 
method available for use with home type video 
cassettes. 

With the continual development of improved 
consumer audio media, such as the compact disc 
(CD) and digital audio tape (R-DAT). and the mar- 
keting of audio processing systems for use with 
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© Method and system for synchronization of an auxiliary sound source which may contain multiple 
language channels to motion picture film, video tape, or other picture source containing a sound 
track. 



© The method of synchronizing with a first audio 
signal (21) of an audio message a second audio 
signal (19) of the audio message at a higher quality 
and wherein said first audio signal was derived from 
a master recording, comprises the steps of: 
causing said second audio signal (19) to be derived 
from said master recording or from a high quality 



duplicate of the master recording; and 
correlating (17) intrinsic characteristics of said audio 
message of said second audio signal with intrinsic 
characteristics of said audio message of said first 
audio signal for synchronizing (23) said second 
audio signal with said first audio signal (21). 
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METHOD AND SYSTEM FOR SYNCHRONIZATION OF AN AUXILIARY SOUND SOURCE WHICH MAY 
CONTAIN MULTIPLE LANGUAGE CHANNELS TO MOTION PICTURE FILM, VIDEO TAPE, OR OTHER 

PICTURE SOURCE CONTAINING A SOUND TRACK 



The present invention is in the field of sound 
synchronization, and more particularly this inven- 
tion relates to a method and system for the syn- 
chronizing of a higher quality sound source with 
another sound source of the same information con- 
tent. This method and system are typified by an 
auxiliary digital sound source being synchronized, 
i.e. locked in time, to an analog sound track of a 
cinema film as the motion picture is being shown, 
or are typified by such an auxiliary digital sound 
source being synchronized to a conventional audio 
portion of a video tape as the video tape program 
is being viewed. 

The higher quality sound source contains a first 
(or "prime") sound track wherein the language 
spoken is identical (except for higher sound quality) 
to the language spoken in the ordinary quality 
sound track of the same information content in the 
other source. This prime track is used for synchro- 
nization with the other source. In addition, the high- 
er quality sound source may contain one or more 
translation sound tracks, each of which is always 
simultaneously running in synchronism with the 
prime sound track. In each such translation sound 
track the spoken language is different from the 
language in the prime sound track and is different 
from the language in each of the other translation 
sound tracks. Each such, translation track provides 
an appropriate translation of the prime spoken lan- 
guage. Thus by virtue of synchronizing the prime 
higher quality sound track with the ordinary sound 
track of the same informational content, each of the 
simultaneously running translation sound tracks is 
also inherently synchronized with the ordinary 
sound track. Therefore, advantageously, each of 
the translation sound tracks is available to be se- 
lected for listening by a cinema audience or by 
segments of the cinema audience sitting in pre- 
selected seating areas having listening devices as- 
signed to respective languages (or selected by an 
individual viewer in a theater or at home desiring to 
hear a particular language furnished by a particular 
one of the available synchronized translation sound 
tracks). 

At the present time, for the case of motion 
pictures, there are various techniques being used 
to permit the use of auxiliary (digital) audio sound 
sources for motion pictures. They require the prep- 
aration of a special film print which contains a 
unique marker code in place of the standard optical 
audio track. The special release print film, along 
with the digital audio recording and special 
playback equipment, is supplied to theaters for 



digital playback- Theaters with regular projectors 
must receive the standard film instead and cannot 
utilize the higher quality digital audio sound sour- 
ces. 

5 One reason why a unique marker code is re- 

quired (rather than merely using the passage of 
time for synchronization) is that the motion picture 
film itself during its repeated handling and showing 
is subject to breakage and consequent film splic- 

70 ing. When the film is spliced, one or more frames 
of the film become lost at the splice depending 
upon whether the breakage was straight across the 
film or was a diagonal tear extending obliquely 
through more than one frame of the motion picture. 

/5 This loss of one or more frames causes the motion 
picture and the sound track on the film to become 
shortened in physical length. Thus, there is a sud- 
den forward "jump" in the motion picture which 
momentarily loses synchronism with the sound 

20 track when the splice passes through the motion 
picture projector aperture. The synchronism is re- 
gained when the splice passes through the sound 
transducer. This momentary loss of synchronism is 
due to the physical film path distance between the 

25 projector aperture and the sound transducer as is 
conventional in motion picture projectors. The 
sound track is conventionally offset along the 
length of the film from the specific frames to which 
the sound track relates by an "offset distance" 

30 equal to the length of the normal film path distance 
in a projector between the optical aperture and the 
sound track transducer. The method and system of 
the present invention do not remove that momen- 
tary loss of synchronism caused by the interaction 

35 of a film splice with the physical film path distance 
between the optical aperture and the sound trans- 
ducer.. 

There are other reasons why a marker code is 
used on the motion picture film for synchronization 

40 of an auxiliary sound source with the film. These 
other reasons include start-up. unexpected stop- 
page due to variety of possible causes and speed 
creepage of either the motion picture projector or 
of the auxiliary sound source. 

45 In the case of video tape, there are many 

synchronizing systems available which use special 
marker coding systems. However, there is no 
method available for use with home type video 
cassettes. 

so With the continual development of improved 

consumer audio media, such as the compact disc 
(CD) and digital audio tape (R-DAT). and the mar- 
keting of audio processing systems for use with 
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VCRs, the home viewer is seeking better quality 
sound, and the home viewer would tike to enjoy 
this better quality sound with video viewing. This 
invention has direct application to this field of bet- 
ter quality sound to accompany video media. 

In the case of editing video tape and film in 
post production, there are many synchronizing sys- 
tems presently in use. However, there are nu- 
merous instances wherein a final or work print of a 
film or video production is made without synchro- 
nizing markers or codes. Additional editing, or re- 
making a better quality master, in which the various 
sources are synchronized to the work print, can be 
advantageously carried out by employing the in- 
vention. 

A considerable expense is involved in produc- 
ing a motion picture. When the picture is com- 
pleted, its available audience is essentially limited 
to those who are fluent in the spoken language 
occurring in the original standard film track. A 
method and system which would enable appro- 
priate spoken translations to be synchronized with 
the showing of the motion picture would consider- 
ably expand the available audience for a given film 
and would advantageously provide for international 
and cross cultural viewings of motion pictures. 

The method and system embodying the 
present invention keep an auxiliary sound source 
(generally the higher quality sound such as from a 
digital tape player) synchronized, i.e. locked in 
time, with the sound track on a motion picture film 
as the film is being projected, or with the video 
tape or program as it is being viewed. Thus the 
visual information is shown in conjunction with the 
auxiliary, generally higher quality, audio (which is in 
perfect synchronism with the picture). 

The method and system of this invention are 
novel inasmuch as they do not utilize nor require 
synchronizing tracks, markers, codes, time codes, 
or other extrinsic (extra) data to be recorded on 
either the film or video tape, or the auxiliary sound 
medium, as do all previous methods. The invention 
utilizes the standard sound track as the source of 
synchronization. 

For employing the invention it is a requirement 
that the high quality and ordinary quality sound 
recordings both contain the same audio message, 
i.e. that they both be made from the completely 
edited original source. For example, this complete- 
ly edited original source is a "master recording" or 
is a high quality duplicate of the master recording. 
Then, the motion picture film's analog optical 
sound track or the video tape's audio track (or 
whatever ordinary sound track for accompanying a 
moving image) is made from this master recording. 
The high quality auxiliary sound medium is also 
made from the master recording, or from a high 
quality duplicate of the master recording, so that 



the ordinary sound track and the high quality auxil- 
iary sound playback medium contain the same 
audio message. In other words, the present inven- 
tion advantageously utilizes the intrinsic (inherent) 

5 information within the audio message itself to 
achieve synchronization of the high quality sound 
signal to the ordinary sound. 

The invention herein advantageously utilizes 
the standard film which contains the optical sound 

w track, or the video tape that contains the magnetic 
audio track, respectively. An auxiliary, higher qual- 
ity recording of the same master is played back. 
The standard audio itself, from the film or video 
tape, provides the information that controls the 

75 timing of the higher quality auxiliary sound source. 
The auxiliary audio becomes locked to the film's or 
video tape's sound track and, therefore, is kept in 
essentially perfect synchronism with the picture. 
This novel synchronizing method and system 

20 offer two major advantages over all other methods 
and systems, First, only a standard motion picture 
theater release print, or standard video tape, needs 
to be prepared and distributed for viewing. This 
single-inventory concept has obvious economic ad» 

25 vantages over making a variety of release print 
types to bring digital audio to the movie audience. 
The same economic advantage applied to the vid- 
eo tape retail market. Secondly, the conventional 
sound track on the film or tape is redundant to the 

30 auxiliary, higher quality sound track and is always 
available to be used as the fall-back mode in case 
the higher quality, digital sound encounters dif- 
ficulty. 

The synchronization method and system of this 

35 invention handle diverse situations of start-up, stop, 
a film or tape splice, and speed creep in either the 
film, tape, or the auxiliary medium. The most dif- 
ficult situation is that of the film or tape splice. 
Many frames may be missing due to the film 

40 breakage and repair. Also in the case of motion 
picture film, it passes through many hands wherein 
frames are sometimes removed by hobbyists col- 
lecting film segments. During film viewing, the mo- 
tion picture image and the audio sequentially jump 

45 ahead at the splice. At a break or splice, the 
synchronization method and system of this inven- 
tion immediately and automatically causes a cross 
fade of the auxiliary audio to the standard track on 
the film print or video track to continue the show. 

so Also, there immediately occurs a shift into a 
"search mode" seeking to re-align synchronism of 
the auxiliary sound with the on-going standard 
sound. As soon as synchronism is achieved, there 
is another cross fade to return the audio playback 

55 to the auxiliary, higher quality sound track. 

In summary . the synchronization method and 
system of the invention, upon a break or splice, 
enable automatic cross fades to the standard audio 
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track on the film print or video for continuing the 
show. Concurrent with the preceding event, there is 
a shift into a search mode seeking to synchronize 
the auxiliary sound track to the on-going standard 
sound track of the picture. When the auxiliary audio 5 
and the picture conform again in synchronism, 
there is a reverse cross fade from the standard film 
or video sound track back to the higher quality 
auxiliary sound track. 

Film creep relates to the normal or usual ten- io 
dency for small differences to occur in reproduced 
speed between the playback of the standard sound 
and the running of the higher quality auxiliary 
sound source. The synchronization method and 
system of the invention prevent any such creeping rs 
differences in timing from occurring and also deal 
with the problem of controlling the operation of the 
player of the higher quality sound source. 

In a further method and system embodying the 
present invention, the auxiliary sound source con- 20 
tains a plurality of sound tracks each containing a 
different spoken language. One of these sound 
tracks is the "prime track" wherein the language is 
identical (except for higher sound quality) with the 
language spoken in the ordinary quality sound 25 
track of the same information content in the other 
source. For example, the ordinary quality sound 
track is the standard English language track on a 
motion picture film or video tape. Thus, the prime 
sound track in the auxiliary source is the higher 30 
quality English language sound track of the same 
information content as on the motion picture film or 
video tape. It is this prime English language track 
which is employed for synchronizing the higher 
quality auxiliary sound source with the picture film 35 
or video tape. The translation sound tracks in this 
auxiliary source which contain the other spoken 
languages are ail running in synchronism with the 
prime tracks, and thus they also are all running in 
synchronism with the standard English language 40 
track on the film or video tape being presented to 
the viewers. Consequently, these synchronously 
running translations are available to be selected for 
listening by various viewers. 

The various features, aspects, objects and ad- 45 
vantages of the present invention will become more 
fully understood from the following detailed de- 
scription and the accompanying drawings, in which 
like reference numbers refer to the same elements 
or components or signals throughout the various so 
FIGURES, in which: 

FIG. 1 is a functional block diagram of a 
method and system embodying the present inven- 
tion for synchronizing an auxiliary sound source of 
higher quality to a motion picture film, video tape 55 
or other moving picture source containing a con- 
ventional sound track of ordinary quality. 

FIG. 2 is a schematic diagram of a digital 



delay line system incorporated in the synchroniza- 
tion system of FIG. 1 . 

FIG. 3 is a schematic diagram of a correla- 
tion system included in the synchronization system 

of FIG. 1. 

FIG. 3A is a functional block diagram of a 
presently preferred system for accomplishing the 
correlation and comparison functions of FIG. 3. 

FIG. 4 is a schematic diagram of a fader 
included in the synchronization system of FIG. 1. 
This fader serves to switch the output signal 
smoothly between a higher quality auxiliary sound 
signal and an ordinary quality sound signal. The 
vast majority of the total time the higher quality 
sound signal is provided through the fader to the 
output. During those occasional instances when 
synchronism is momentarily lost due to splices 
involving missing segments of the moving picture 
source, as is explained later in detail, the fader 
automatically smoothly switches over to provide 
the ordinary quality sound signal to the output for 
maintaining continuity of the audio message, while 
synchronization is being regained for the higher 
quality sound signal, as explained later. 

FIG. 5. is a plot illustrating switch-over char- 
acteristics of the fader of FIG. 4, showing how the 
higher quality sound signal voltage gain is smooth- 
ly decreased during a switch-over interval of time, 
while the lower quality sound signal voltage gain is 
smoothly increased, and vice versa during a re- 
verse switch-over. 

FIG. 6. is a functional block diagram of the 
entire synchronization method and system shown 
in FIG. 1, except that FIG. 6 shows more details of 
the entire system, as will be better understood after 
considering the details of the various components 
and their functions as explained in connection with 
the intervening FIGs. 2 through 5. 

FIGS. 7A and 7B are to be viewed together 
as one drawing showing a functional block diagram 
of a method, apparatus and system embodying the 
present invention for synchronizing an auxiliary 
sound source to a motion picture film, video tape 
or other moving picture source containing a con- 
ventional sound track of ordinary quality. The auxil- 
iary sound source contains a prime sound track 
wherein the spoken language matches the spoken 
language in the sound track of the motion picture 
source, except that the prime track is preferred to 
be of higher quality sound. In addition, the auxiliary 
sound source contains one or more translation 
sound tracks running in synchronism with the 
prime track and each containing a different spoken 
language. Thus, a particular spoken language can 
be selected to be heard by the viewer as may be 
desired. 

FIG. 8 shows a functional block diagram, 
similar to FIG. 2, of a preferred digital delay line 
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system for use in the synchronizing system 40 
shown in FIG. 7B. This digital delay line system in 
FIG. 8 includes a firsHn first-out overwriting mem- 
ory store, for accommodating "N" channels and 
having a language selector switch at the output, as 
also shown in FIG. 7B. 

The following detailed description makes use 
of block diagrams, and various components are 
explained in terms of their functional operation. It is 
to be understood that these components can be 
implemented in various ways, using either analog 
or digital techniques as will become understood by 
those skilled in the art in reading the following 
description with reference to the accompanying 
drawings- 
Attention is invited to FIG. 1 which serves to 
explain the principles of operation and functional 
steps employed in one method and system em- 
bodying the present invention. There are two input 
ports or terminals 10 and 11. The first input port 10 
receives a signal from the standard or ordinary 
sound track normally accompanying the visual me- 
dia. In many cases this first input port 10 will be 
receiving an ordinary analog signal being transmit- 
ted over a two-line audio connection 13, for exam- 
ple this analog signal is originating from the sound 
track on a cinema film or from a sound track on the 
audio portion of a video tape. This analog input 
signal at the ordinary sound signal input port 10 
comes from the film's stereo sound output and is 
the audio voltage that normally would go to the 
theater's sound system. The number 2 on this line 
13 indicates a two-line or two channel connection. 

Although the illustrative method and apparatus 
embodying the invention is shown handling a two- 
line or two-channel stereo input signal 21, it is to 
be understood that the invention is not limited to 
the handling of two-channel stereo. The method 
and system of this invention also can be applied to 
advantage for handling monaural sound signals and 
also for handling multi-channel "surround" stereo 
system sound, which may involve 4-channels or 6- 
channels. etc. 

The second input port or terminal 1 1 serves to 
receive the higher quality sound signal, which cor- 
responds with the ordinary sound signal. For exam- 
ple, this higher quality sound signal is a digital 
signal coming from an auxiliary digital sound stor- 
age system (not shown). As explained in the SUM- 
MARY above, the one requirement for employing 
this invention is that this higher quality auxiliary 
sound source need have been made (recorded) 
from the original same sound master as the or- 
dinary sound signal recording. This auxiliary higher 
quality sound signal source (not shown) does not 
form part of the present invention in regard to the 
disclosure in our patent application as filed on 
December 15, 1987. (With regard to our 



continuation-in-part patent application wherein the 
auxiliary sound source includes translation sound 
tracks running synchronously with a prime sound 
track, in the same language as the ordinary sound 

5 signal recording, we believe that the auxiliary 
sound signal source is patently novel.) The auxil- 
iary storage system may be any one of many high 
quality sound playback systems, such as a com- 
pact disc (CD), rotary digital audio tape (R-DAT), 

w video cassette adapter system (Sony model F-1 or 
PCM-1630 series), or one of the digital audio sta- 
tionary head machines (DASH). The input line 14 
from the higher quality input port 1 1 is indicated by 
the number 32 to be a thirty-two line digital audio 

is signal transmission buss representing, say, two 
channels of 16 bit parallel audio lines. 

The method and system shown in FIG 1 has a 
single audio signal output port or terminal 12, for 
example a two-line stereo audio output terminal. 

20 This output terminal 12 provides the audio voltage 
that drives the theater's sound system. The intent 
is that this audio output voltage at terminal 12 will 
come from the higher quality digital sound signal 
input, whenever digital program material is present, 

25 or whenever a transition is not occurring. If there is 
not higher quality sound signal source, then the 
output at terminal 12 will contain the conventional 
ordinary sound signal being received at the input 
port 10. 

30 There is also a control terminal 15 which 

serves to control both the rate of the higher quality 
audio digital information being received at the sec- 
ond input terminal 11 and also controls the speed 
of the playback mechanism of the high quality 

as sound source. 

FIG 1 shows three major functional blocks: a 
fader 16, a correlation system 17, and a delay line 
system 18. Although each functional block 16. 17 
and 18 will be discussed in detail in later sections, 

40 it is helpful to the reader to provide first an over- 
view of their respective functions. 

The fader 16 switches between the conven- 
tional or ordinary audio signal supplied via a con- 
nection 20 and the higher quality sound signal on a 

45 connection 22 from the delay system 18. This 
fader is controlled by proper commands from the 
correlation system 17, and these command signals 
are provided to the fader 16 from the correlation 
system 17 as indicated by the dashed line (control 

50 function path) 24. 

However, this fader 16 is not an ordinary 
switch; it is a cross fade device, which is similar in 
concept to a -dissolve" for slide projectors. If the 
command is given to switch from, say, ordinary 

55 input on line 20 to higher quality input on line 22 
then the ordinary sound signal would be attenuated 
over time to reach full off, and the higher quality 
sound signal would be augmented from off to full 
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on, over the same time period. This type of fader 
"switch" produces a benign transient which, for 
most program material, is inaudible to the audi- 
ence. In this case, ail that would be noticed over 
time is an improved audio characteristic, due to the 
higher quality digital playback audio signal on line 
22. There is no annoying "pop" due to the 
switchover. 

For providing a practical illustrative example of 
an application in which the method and system of 
this invention can be employed to good advantage, 
this description will now focus upon synchronizing 
a higher quality auxiliary digital sound signal 19 
with an ordinary analog sound signal 21 coming 
from a cinema film, as the motion picture is being 
shown in a theater. 

The delay line system 18 may have any de- 
sired practical delay. In this example, the digital 
delay line system 18 handles the sound for up to 
ten seconds of missing motion picture film frames, 
and thus it has a ten-second delay capability. In 
addition, this delay line system 18 must have the 
same digital word width and the same average 
sample rate as the digital audio signal 19 which is 
fed into the input port 11. In this example the high 
quality sound signal 19 on the thirty-two line buss 
14 is characterized by two channels of sixteen-bit 
words having a sample rate of 48 kiloHertz each. 

It is to be noted that this delay-line system 18 
determines the maximum range of time synchro- 
nization capability, e.g. up to 10 second of missing 
film frames. It is desired that the fidelity or quality 
of the high quality analog sound signal 23 at the 
output of 26 be equal to the fidelity or quality of the 
entering high quality sound signal 19 for providing 
the full advantages of the present invention. In 
order to achieve the preservation of quality, it is 
necessary that the delay-line system 18 have the 
same (or greater) number of bits per sample as the 
entering digital sound signal 19. (It is also possible 
for the delay-line system to have a faster sample 
rate than the entering digital sound signal 19, pro- 
viding an appropriate sample rate converter be 
utilized in conjunction with the input port 28.) 

The delay line system 18 is intended to store 
as long a time-segment of the digital audio signal 
19 as permitted by its capacity, e.g. a ten second 
time-segment. The output end 26 of this delay line 
system is generally running in exact synchronism 
with the ordinary audio signal 21 . (However, when- 
ever a film splice due to missing film frames has 
just been encountered; then, the output end 26 will 
momentarily be running behind exact time synchro- 
nization with the ordinary sound signal 21; the 
fader 16 will be switched over for transmitting the 
ordinary signal 21 to its output 12; and the delay 
line system 18 will b8 operating in a synch-search 
mode to be explained later.) 



It is to be noted that the delay line system 
output end 26 includes a digital-to-analog converter 
(DAC) 30 (FIG 2) for converting the digital signal 
19, which has been stored in the delay line into a 

5 high quality analog audio signal 23, being fed over 
a two-line connection 22 to the fader 16. 

It is to be understood that this delay line sys- 
tem 16 is filled with digital signals for high quality 
sound which is LATER IN TIME (emphasis in- 

io tended) e.g. up to ten seconds later in time, than 
the instantaneous present time of the ordinary 
sound signal 21. Whenever a film splice (missing 
frames) is encountered, then the correlation system 
17 advantageously instructs that the high quality 

75 analog audio output signal 23 supplied from the 
output 26 of the delay system be derived from 
stored digital signals at a later time (towards the 
input end 28 of this delay line.) 

In an advantageous effect on the output the 

20 derivation tap 32 is moved ahead (later) in time by 
being shifted toward the delay line input end 28. In 
other words, the high quality analog signal 23 must 
be caused to "jump ahead" in order to regain 
synchronism with the film sound track signal 21 

25 which has already experienced a jump ahead due 
to missing film frames. The left/right arrow 34 in- 
dicates that the correlation system 17 provides the 
output tap control 32 for determining the location 
within the delay line system 13 of the digital sig- 

30 nals from which the high quality analog signal 23 is 
derived. 

The input end 28 of the delay line system 18 
receives its input signals 19 from the auxiliary 
digital sound source medium. The momentary rate 

35 that the digital samples are received is controlled 
by the auxiliary digital sound source player control 
15. For the missing frame situation described 
above, the momentary rate of the digital samples is 
now increased. Since the sample rate of the signals 

40 19 is now momentarily faster than normal, the 
delay output tap control 32 is caused to move 
slowly from the jump-ahead position back to the 
output end 26 of the delay line 1 8. in order to be 
available to react for any subsequent missing 

45 frames. The digital sound storage medium is then 
returned to it's nominal rate by the player control 
15, when the delay output tap control 32 has again 
reached the output end of the delay line 18. 

When the delay output tap control 32 is at the 

so output end 26 of the delay line system 18. then this 
illustrative system as described has its normal ca- 
pacity to maintain almost uninterrupted availability 
of synchronized high quality analog sound signals 
23 up to a ten-second time-segment of missing 

55 film frames. 

In the event that a 6-second time-segment of 
missing frames has just been encountered, then 
the delay tap 32 will quickly be shifted to a point as 
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shown in FIG. 1 which corresponds with 6 seconds 
from the output end 26 and 4 seconds from the 
input end 28. In this particular situation, as shown 
in FIG. 1. the system still retains the capability to 
maintain almost uninterrupted availability of syn- 
chronized high quality analog sound signals 23 up 
to the occurrence of a 4-second time-segment of 
missing frames close in time with the 6-second film 
splice "break" which has just been encountered. 

In the event that a film splice "break" longer 
than 4 seconds is encountered close in time, after 
the occurrence of a 6-second film splice "break" 
represented by the showing in FIG 1, for example 
assume that a 7-second film splice "break" is now 
encountered, then the delay control tap 32 is shift- 
ed to a position at the very front end 28 of the 
delay line system 18. When the initial 6-second 
film splice "break" was encountered, it caused the 
digital player via line 15 to begin running at a faster 
rate than normal in order to reset itself to the 
normal 10-second digital storage. The digital player 
continues to run at this faster than normal rate 
when the 7-second "break" is encountered. The 
sum of a 6-second and then a 7-second film splice 
"break" is 13 seconds, which is recognized to 
exceed by, 3 seconds, the 10-second delay stor- 
age capability of this particular system 18, i.e. 
there is a 3-second time segment "gap." Con- 
sequently, the availability of synchronized high 
analog sound signals 23 is "lost" for a short while 
until this 3-second "gap" can be closed. The the- 
ater audience now heard the ordinary analog signal 
21 while the "gap" is being closed. The digital 
player is continuing to run faster than normal, and 
soon the digital signals 19 arriving at the front end 
28 correspond in time with the ordinary signals 21 . 
The 3-second "gap" has now been closed, and the 
delay tap control 32 causes these appropriately 
synchronized high quality analog sound signals 23 
to appear at the output 28 of the delay line system 
18. The fader 16 now shifts over to the high quality 
sound signals 23. The digital player continues to 
run faster than normal, while the delay tap control 
32 is caused progressively to move (arrow 34) 
along the delay line system 18 towards the output 
end 26. When this delay control tap 32 reaches the 
output end 26, then once again this output end 26 
is exactly synchronized in time with the occurrence 
of the on-going ordinary sound signals 21 . 

Small corrections in speed are made either by 
causing the digital player control 15 to slightly 
adjust the average playback speed of the digital 
medium or by moving the position (arrow 34) of the 
delay tap control 32 along the delay line system 
18. or a combination of both small corrections can 
be used. The important point to be understood is 
that small corrections in timing can be made on an 
almost continuous basis to keep the digital signal in 



exact synchronization. 

As mentioned previously, it is to be noted that 
the number of communication "lines" for each con- 
nection (for each buss or communication pathway) 

5 is indicated by a numbered slash on the connec- 
tion. It is to be understood that each communica- 
tion line has an associated return (or ground) con- 
ductor in order to complete the circuit for the 
communication line. In some instances there is a 

w common return (or common ground) for a plurality 
of communication lines. For example, in FIG. 1 the 
output pathway 12 for the signal voltage being fed 
to the stereo loudspeaker system of the theater has 
a "2" numbered slash, thereby indicating two com- 

J5 munication lines, namely one line for the left side 
stereo loudspeakers and a second line for the right 
side stereo loudspeakers. As understood by those 
skilled in the art, there is also a return conductor 
(not shown) for each of these two output signal 

20 lines, and that return conductor may comprise a 
common return at ground potential for both lines. 

The whole synchronization system shown in 
FIG. 1 is generally indicated by the reference num- 
ber 40. 

25 Inviting attention to the correlation system 17, it 

is to be understood that this system 17 provides 
two functions: (a) analysis and comparison of the 
ordinary quality analog sound signals 21 , which are 
fed in over a two-line path 36 to an input port 38, to 
30 high quality digital sound signals 19, which are fed 
in on a 16-line path 42 to input terminal 44 of the 
correlation system 17, and (b) controlling the whole 
synchronization system 40. The reason for a two- 
line path 36 is to handle both the left analog stereo 
35 signal and the right analog stereo signal. 

In the analysis and comparison function, the 
correlation system 17 is analyzing the envelope of 
the ordinary quality analog sound signals 21 and is 
comparing the results of this analysis with the 
40 envelope of digital audio signals which are fed over 
a sixteen-line input buss 42 to a high quality digital 
sound signal input terminal 44 of the correlation 
system 17. The reason for using the sixteen-line 
input buss 42 is to accommodate both left and 
45 right digital audio signals as 8-bit parallel words. It 
is seen in FIG. 1 that the higher quality digital 
audio signal on input buss 14 comprises 1 6-bit 
words for both left and right stereo digital audio, 
thus requiring a 32-line buss 14. In this present 
so embodiment of the invention the least significant 
eight bits of both the left and right stereo audio 
words are not communicated via the sixteen-line 
input buss, because the correlation system 17 op- 
erates with regard to average envelope information 
55 and does not require greater precision than pro- 
vided by the sixteen-line buss 42, as will be ex- 
plained later. From the comparison of the inputs at 
terminals 38 and 44, the correlation system 17 
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determines at each instant the appropriate delay 
tap 32 of the delay line 18 from which to feed the 
output 26. 

As part of its overall control functions (b) men- 
tioned above, the correlation system 17 determined 5 
the appropriate command signals fed to the output 
15 for instructing operation of the digital playback 
medium and also determines the appropriate com- 
mand signals fed via control path 24 for instructing 
operation of the fader 16. 10 

This correlation system 1 7 includes microcom- 
puting elements and performs various internal func- 
tions in accordance with algorithms to be explained 
later. 

In this practical implementation of the synchro- is 
nizer system 40. the correlation system 17 also 
contains the instructions and sub-routines for start- 
ing the film and controlling the higher quality auxil- 
iary digital audio, including starting, stopping, and 
perhaps rewinding the digital audio medium, and 20 
all other control matters pertaining to the system 
automation. For example, the synchronizing system 
40 employs a delay line 18 of, say 10 seconds. 
Consequently, the digital audio medium will have to 
start running ten seconds in advance of the cinema 25 
film in order to fill the digital delay line 18 before 
the film starts showing (before the ordinary analog 
signals 21 start arriving at the input 10). This ten 
second "head start" for the digital player will there- 
by fill the ten-second delay line so that the first 30 
digital signal output at 26 will exactly correspond 
with the first ordinary analog signal arriving on the 
input connector 13. Instead of a ten-second head 
start, the digital player and the delay line 18 may 
be arranged to made a "fast dump" of the data 35 
corresponding to ten-seconds worth of higher qual- 
ity sound signal 19. Such a "fast dump" may occur 
in much less than ten seconds. 

40 

DIGITAL DELAY LINE SYSTEM 18 

FIG. 2 shows a functional block diagram of a 
presently preferred digital delay line system, com- 
monly called a FIFO, or first-in first-out overwriting 45 
memory store. This digital delay line system 18 
operates as follows: the higher quality digital audio 
signal data 19 is presented via the 32-line input 
buss 14 to the input 28 of a write address gener- 
ator 50. 

50 

An address (memory location) 48 is assigned 
and, as indicated by the arrow 52, the digital audio 
information is stored there in a random access 
memory (RAM) 54. The digital information is writ- 
ten into the memory 54 sequentially until all the 55 
memory is filled. Then, the process is repeated by 
replacing the previous data with the new informa- 
tion in the same sequence. The memory 54 must 



be sufficient to store the required number of data 
samples to make up the desired delay time of ten 
seconds. For example, to accommodate ten sec- 
onds of left stereo sixteen-bit words and right ste- 
reo sixteen-bit words at a sample rate of 48 kHz 
the memory capacity is at least 480 k times 32 
bits, as indicated. 

The output at 26 from the whole delay line 
system 18 comes via a read address generator 56. 
For a maximum delay of. say, ten seconds, the 
chosen address indicated by the function arrow 58 
is that of the digital audio data (digital audio word) 
which has been resident in the memory 54 for the 
maximum available ten seconds, i.e. the longest- 
resident digital audio word in memory. This 
longest-resident digital audio word is the first-as- 
signed digital audio word of all words currently in 
memory. This maximum-delay word is then pre- 
sented, as indicated by the function arrows 62 and 
64, to the digital-to-analog converter (DAC) 30 and 
appears at the output 26. 

This maximum delay situation as just de- 
scribed means that the output data stream 62, 64 
is exactly the same as the input data stream 52, 
except that a ten-second time difference exists. 
Turning attention back to FIG. 1, this maximum 
delay situation is indicated when the delay output 
tap 32 is located at the very output end of the 
delay line system 18. 

It is noted that the delay time may quickly and 
appropriately be reduced from maximum by the 
advantageous expedient of assigning a new ad- 
dress 58 (FIG. 2) to the read address generator 56 
from which the sequential process continues. For 
example, assigning an address 58 halfway through 
the memory 54 instantly advances the high quality 
audio signal 23 in time by fifty percent of the delay 
line's length, namely, by five seconds in this delay 
line system 18. This process of assigning a new 
address 58 from which to chose the next word in 
wuch a FIFO overwriting store is sometimes called 
"changing the read pointer position". 

FIGs. 1 and 2 both show the digital audio input 
buss 14 as having 32-lines. These 32-iines provide 
for a parallel feed of two 16-bit wide pulse code 
modulated (PCM) words for left and right stereo 
digital audio as occurs in currently commercially 
available high quality digital sound systems. The 
digital output 62, 64 is similarly on 32-lines, and 
this digital output feeds the DAC 30 which provides 
the high quality analog stereo sound signal 23 for 
driving the theater's sound system. 

As shown in FIG. 2, there are two control 
busses 66 and 68 coming from the correlation 
system 17 (FIG. 1). For clarity of illustration in FIG. 
1 and for clear explanation, these control busses 
66 and 68 are considered to be included within the 
control pathway 67 shown in FIG. 1 extending from 
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the correlation system 17 to the delay output tap 
32, 34. It is to be understood that each of these 
control busses 66 and 68 contains multiple com- 
munication lines.. The first control buss 66 serves to 
control the write address generator 50, and the 
second control buss 68 controls the read address 
generator 56 and serves to determine the read 
address location 58, i.e. "determines the read 
pointer's position." 

There is a master clock 69 (FIG. 6) for control- 
ling the timing of the digital processes throughout 
the synchronisation system 40. As indicated by the 
arrows 70, clock pulses are fed to the write ad- 
dress generator 50, to the read address generator 
56, and to the DAC 30. 



CORRELATION SYSTEM 17 

As discussed above in the preliminary descrip- 
tion of the correlation system 17 (FIG. 3) and its 
operation, this correlation system serves as the 
controller for the synchronization system 40 (FIG. 1 
or 6) as a whole. This correlation system 17 in- 
cludes signal processors, digital storage capability, 
correlation circuits, control circuits and a central 
processing unit (CPU) 31 which controls and keeps 
track of all activities within the synchronization sys- 
tem 40. 

In the activity of correlation, the system 17 is 
continuously assuring that the higher quality digital 
audio being supplied to the DAC 30 (FIG.2) at the 
output end 26 of the delay line system 18 is the 
same, but higher quality, sound as the conventional 
analog audio signals 21 (FIGs. 1 and 3) coming 
from the film being shown. If the film audio signal 
21 becomes different from the digital audio signal 
about to arrive at the DAC 30, then the correlation 
system 17 causes the overall synchronization sys- 
tem 40 to make an appropriate response, as ex- 
plained in detail later. 

It is to be understood that as used in this 
specification the term "correlation" is intended to 
have a precise engineering or mathematical mean- 
ing. As used herein "correlation" means to com- 
pare and calculate unambiguously that the ordinary 
sound signal 21 (FIG. 1 or 3) which is now being 
received at the input connection 13 and the higher 
quality sound signal being delivered from the out- 
put end of the digital delay line system 18 carry 
the same audio message. 

Since the ordinary sound signal 21 is being 
derived from the portion of the motion picture cur- 
rently being shown, this ordinary signal always 
contains the appropriate audio message to accom- 
pany the current picture. When missing picture 
frames are encountered due to a film splice, the 
motion picture suddenly apparently "jumps ahead" 
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in time, and the ordinary quality audio message 21 
makes a similar corresponding jump ahead in time. 
When a difference in the two audio messages is 
sensed by the correlation system 17. a "synch 

5 search" mode immediately is initiated, and the 
fader 16 is caused to switch over to convey the 
ordinary quality sound signal 21 to the theater 
sound system. The correlator 17 immediately be- 
gins to determine the new address to place the 

w read pointer 58 (FIG. 2). which is later in time or 
closer to the input end 28 (FIG 1). As soon as the 
new address 58 for the same audio message has 
been found, synchronization has been re-estab- 
lished, and the stored digital audio from this new 

75 address immediately is sent through the DAC 30 to 
the output 26. The fader 16 (FIG.1) is immediately 
switched back to convey the appropriate, re-syn- 
chronized high quality audio signal 23 to the the- 
ater sound system. 

20 It is to be noted that this correlation process is 
re-iterative. That is, the envelopes of two audio 
signals are being compared by repeatedly rapidly 
comparing in sequence the magnitudes of the vol- 
tages of the envelope of the high quality digital 

25 audio at a plurality of addresses in a memory store 
with the present magnitude of the voltage of the 
on-going ordinary quality audio. In effect, the cor- 
relation process is looking for (is seeking) that 
particular sequence of addresses on a memory 

30 store where the magnitudes of the voltages of the 
envelope of the high quality digital audio over a 
brief time interval match with (track along with) the 
magnitudes of the voltages of the envelope of the 
on-going ordinary audio over the same brief time 

35 interval. In other words, a sequence of numbers 
representing magnitudes of the voltages of the high 
quality audio envelope are correlated with, i.e. are 
matched over a brief time interval with (and are 
found to track along with), a sequence of numbers 

40 representing magnitudes of the voltages of the on- 
going ordinary quality audio envelope occurring 
over this same brief time interval. In the present 
embodiment of this invention, this correlation is 
advantageously achieved by re-iterative subtrac- 
ts tion. Various sequences of numbers for the en- 
velope of the high quality sound and the current (at 
the present time) sequences of numbers for the 
envelope of the on-going ordinary sound are re- 
peatedly subtracted from each other to provide 

50 difference values "D" in FIG. 3. Difference values 
"D" which are near zero and which remain near 
zero over an interval of time at a particular se- 
quence of memory store addresses, i.e. at a par- 
ticular read, pointer position, are said to be yielding 

55 a high correlation, i.e. to be indicating that this 
particular read pointer position is the appropriate 
position for synchronization. 

When the re-iterative correlation is "high/ then 
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the correlation system 17 accepts the read pointer 
position. If the correlation is poor, i.e. the difference 
values "D" are not near zero, then the comparison 
is repeated, until a new pointer position is found 
where the correlation again becomes high and re- 
mains high over a brief interval of time. 

Also, during the time while no pointer position 
is found where the correlation is high, then the 
fader 16 is caused to remain changed over to the 
conventional analog signal 21 so that this conven- 
tional signal 21 is supplied at the output 12 to the 
theater's loudspeaker system. When a new pointer 
position is found where the correlation is high, the 
corresponding high quality digital audio signal from 
this new pointer position immediately goes to the 
memory store output 26 (FIG. 2), and the fader 16 
is rapidly switched to feed this resulting new high 
quality audio signal 23 to the output 12. 

FIG.3 shows a functional block diagram of the 
correlation system 17 for making the re-iterative 
subtract! ve comparison as described above. The 
stereo analog audio signal 21 approaching the in- 
put terminal 38 has its left (L) and its right (R) 
stereo signals added together in adder 37, and the 
resulting monaural analog signal enters the input 
38 of an ADC (analog-to-digital converter) 72 in 
which this monaural analog signal is converted to 
an 8-bit monaural digital representation 74. It is this 
monaural signal which is converted into the 8-bit 
digital representation 74. This digital representation 
74 is fed by an 8-line connection 76 into a proces- 
sor 78 which obtains the absolute instantaneous 
values of the digital representation 74 by an ab- 
solute value algorithm which causes all negative 
numbers to become positive and then band limiting 
the result by a low pass digital filter algorithm 
which provides new digital numbers representing 
the "absolute value envelope" (no negative num- 
bers) confined to less than a predetermined fre- 
quency. For example, in the present embodiment 
of the invention this predetermined frequency limit 
for the low-pass digital filter algorithm is 50 Hz. 

The reason for using a low-pass upper limit of 
less than about 50 Hz is that such a frequency is 
sufficiently high to characterize with suitable defini- 
tion the "syllabic structure" of intelligible audio 
messages and is low enough to avoid imposing 
unduly or unnecessarily high rate requirements on 
the correlation system 17. 

The result of this processing in the processor 
78 is to provide a digital signal 80 on a buss 94 
containing a sequence of digital numbers repre- 
senting the absolute value envelope confined to 
less than 50 Hz of the monaural combination of the 
L and R analog audio signal 21. Therefore, this 
representative digital signal 80 advantageously 
gives a useful representation of the audio mag- 
nitude distribution occurring within the "syllabic 
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structure" of the on-going ordinary quality audio 
message 21. In other words, this envelope repre- 
sentation signal 80 contains very useful information 
about the on-going sequence of syllables (on-going 
5 significant events) which characterize the ordinary 
quality audio message 21 , but this envelope repre- 
sentation signal 80 does not contain enough digital 
data to define the precise waveform of the ordinary 
quality analog stereo signal 21 . By virtue of using 
70 this syllable-type absolute value envelope repre- 
senting signal 80, the rate requirements of the 
correlation system 17 are correspondingly lower as 
compared with using more precise representation 
of the original analog stereo signal 21. 
75 The digital signal 82 supplied over the 16-line 

buss 42 comprises two 8-bit words for the respec- 
tive left and right stereo digital audio. The eight 
least significant bits of the L and R stereo digital 
words in the high quality signal 19 on the 32-line 
20 input buss 14 are omitted from the 16-line buss 42, 
as discussed further above. This digital signal 82 is 
supplied to a processor 84 which operates in a 
manner similar to the processor 78 plus the adder 
37 and ADC 72 described above. Thus, the proces- 
25 sor 84 combines the L and R 8-bit stereo words 82 
into an 8-bit monaural word and then uses an 
absolute value algorithm and a low-pass digital 
filter algorithm confined to the same frequency limit 
being used by the processor 78, namely 50 Hz t for 
30 producing a digital signal 90 on a buss 86. This 
digital signal 90 contains a sequence of numbers 
representing the absolute value envelope confined 
to less than 50 Hz of the combination of the L and 
R digital audio signal 82. Therefore, this repre- 
35 sentative digital signal 90 gives a useful repre- 
sentation of the audio magnitude distribution occur- 
ring within the "syllabic structure tt of the high qual- 
ity digital audio message 19 (FIG. 1). This en- 
velope representation signal 90 contains very use- 
40 ful information about the sequence of syllables 
(sequence of significant events occurring with pas- 
sage of time) which characterize the high quality 
digital audio message 19, but this envelope repre- 
sentation signal 90 contains considerably less than 
45 enough digital data to define the precise analog 
waveform which is delineated by the high quality 
stereo signal 19. 

In the functional block diagram in FIG. 3, the 
envelope representation signal 90 is being shown 
50 supplied by a connection 86 to a low complexity 
delay line 92 having the same time-delay length, 
for example ten seconds, as the high quality digital 
delay line system 18 (FIGs. 1 and 2). The envelope 
signal 90 (for the digital audio message 19) pre- 
ss cedes the other envelope signal 80 (for the analog 
audio message 21) by the time-delay of the delay 
lines 92 and 18, say ten seconds, because the high 
quality auxiliary digital sound medium was started 
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running ten seconds before the cinema film was 
started running. This ten-second "head start" of the 
digital audio message thus causes the envelope 
signal 90 to precede the envelope signal 80 by ten 
seconds in this embodiment of the invention. Con- 
sequently the delay line 92 has been supplied with 
and has become filled with the most recent ten 
seconds of the envelope representation signal 90. 

It is to be understood that a delay of less than 
ten seconds, for example eight seconds or six 
seconds can also be used to good effect, if de- 
sired. The acceptable compromise of using a shor- 
ter delay time than the presently preferred pre- 
determined delay in the range of about 8 seconds 
to 10 seconds merely causes lessened capability 
to maintain uninterrupted synchronization of the 
higher quality sound when showing spliced motion 
picture film wherein the splices involve significant 
time-segments of missing frames. Due to an ac- 
ceptable compromise of using a shorter delay time 
storage capability than about 8 seconds, the fader 
16 will switch over somewhat more often to the 
conventional signal 21 and some such switchovers 
will have a longer time duration than would occur 
with a longer delay time capability when showing 
any given motion picture film with a significant 
number of splices. At the present time we believe 
that a delay time storage capability of about three 
seconds is the practical lower limit for suitable, 
good effect operation with the standard used re- 
lease print containing significant numbers of signifi- 
cantly long missing time-segment splices. 

Inviting attention again to FIG.3. (and is ex- 
plained above) the envelope signal 90 is earlier in 
time than the signal 80 by the pre-determined 
delay-time capability of the low complexity delay 
line 92 which exactly equals the predetermined 
delay-time capability of the high quality digital de- 
lay line system 18. This low complexity delay line 
92 is shown as having numerous output taps T1 
through Tn located at spaced equal time-delay 
increments. For example, these time-delay intervals 

are spaced uniformly 100 milliseconds apart. 

It is helpful in explaining and in understanding 
this embodiment of the invention to think initially in 
terms of taps "T" spaced along a delay line 92 by 
uniform increments of time, e.g. 100 milliseconds. 
Further description below in conjunction with FIG. 
3A showing a FIFO overwriting memory store 114 
will complete the full explanation and understand- 
ing of this correlation system 1 7 (FIG. 3). 

Sequential re-iterative comparisons C1 through 
Cn are being made between the on-going digital 
numbers 80 on the buss 94 with the stored digital 
numbers 90 at the respective time points T1 
through Tn in the delay line 92. These comparisons 
are advantageously being made by sequential sub- 
tractions St through Sn, and the resulting sequen- 



tial numerical differences 01 through Dn are fed 
into the CPU of the functional block 31. The par- 
ticular re-iterated subtractions S whose difference 
D currently (now) has a numerical value approach- 

5 ing zero and remaining near zero over a brief 
interval of time is that subtraction whose input tap 
T has present numbers equal to the present in- 
stantaneous numbers of the envelope representa- 
tion 80 on the comparison buss 94. It is this 

w particular D presently having a near zero value 
which serves as the "marker" for the CPU 31 for 
selecting the appropriate delay time to use for 
moving the output tap 32 (FIG. 1) to the appro- 
priate delay time location in the digital delay line 

75 system 18. 

The foregoing explanation in terms of a moving 
tap is for aiding in understanding the present em- 
bodiment of the invention. With attention invited to 
FIG. 2 and FIG. 3 it will be seen that it is the 

20 particular re-iterated subtraction S whose difference 
D currently has a near zero value and which re- 
mains near zero over a brief time interval which 
serves as the "marker" for causing the CPU 31 
acting through the control buss 68 to instruct the 

25 read address generator 56 to address 58 the new 
appropriate memory location in the memory unit 
54. Starting at this new address the read signal 
generator 56 now causes the read pointer position 
58 to scan through the sequential locations in the 

30 memory store 54 for bringing the appropriate se- 
quence of digital words to the DAC 30 for produc- 
ing the appropriate high quality analog stereo volt- 
age output signal 23 synchronized with the or- 
dinary quality signal 21 . 

35 It is presently preferred that a FIFO overwriting 

memory store 114 (FIG. 3A) t similar to that shown 
in FIG. 2, be used to serve as this low complexity 
delay line 92 (FIG. 3). Then, a microprocessor, 
CPU, using a time-share program, serves to per- 

40 form the numerous subtractions Sl....Sn and acts 
through a control buss 95 in conjunction with the 
FIFO overwriting memory store system 114. 

For example, in this correlation system 17 the 
CPU is performing subtractions S (FIG. 3A) at the 

45 rate of 1,500 samples per second. A subtraction S 
(FIG. 3A) is performed, and the resultant difference 
goes into a particular memory store location Dl 
through Dn in the CPU. Then the next subtraction 
is performed using the number now stored at an 

50 address in the FIFO memory which is spaced 100 
milliseconds from the address for the preceding 
subtracted number, and the resultant difference 
goes into a next particular memory store location 
D1 through Dn in the CPU. This sequential subtrac- 

55 tion is continued until all of the difference memory 
store location D1 through On have each received 
respective difference numbers and then the sub- 
traction process continues repeating over and over 
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at the sample rate of 1,500 per second. The mem- 
ory store locations D1 through On in the CPU are 
each cumulative, and they each have the same 
discharge or drain-down rate. Thus, the particular 
memory store location D1 through Dn, which cur- 
rently is storing a cumulative difference nearest to 
zero and whose stored cumulative difference re- 
mains nearest to zero, is the "marker" as de- 
scribed above for selecting the appropriate read 
address 58 (FIG. 2) for synchronization. 

In this example, where the subtraction sample 
rate is 1.500 per second, where the delay time 
storage of the FIFO memory store 54 in FIG. 2 and 
also that of the store 114 in FIG. 3A is 10 seconds, 
and where the sampled addresses are spaced 
apart 100 milliseconds (0.1 second), then there are 
100 addresses (which means n equals 100) being 
sampled, and so the repetition rate for sampling 
each particular address in 15 times per second. 

There is a realistic basis for these values being 
used in this embodiment. Sound travels at about 
1,100 feet per second through air at sea level. In a 
theater where some of the audience is about 110 
feet away from the screen, the audience in the rear 
of the theator is not concerned that the audio 
message as actually heard is 1/1 0th of a second 
behind the action being seen on the screen. Thus, 
a 100 millisecond (1/1 0th sec.) spacing of the sam- 
pled addresses is sufficiently close together to 
yield high quality results, because the time syn- 
chronization between the high quality sound 23 and 
the motion picture being seen will always be within 
1710th of a second. Actually, the synchronization 
will be within much less than this 1/1 0th second for 
most of the time, because the CPU is continually 
acting in a direction to cause the near-zero cumula- 
tive difference stored in the particular current 
"marker" memory storage location D to approach 
zero, meaning that progressively closer synchro- 
nization is being provided, until such time as the 
occurrence of the next film-splice break due to 
missing frames. 

The CPU 31 controls the entire synchronization 
system 40 (FIG. 1 or FIG. 6). Thus, this CPU 
examines all of the cumulative correlator differ- 
ences stored in memory locations D1....Dn t 
chooses the appropriate pointer location, controls 
the read address generator 56 (FIG. 2) in the digital 
audio delay line system 18. In addition the CPU 
continues to update the write address generator 50. 
Concurrently, the CPU runs the low complexity 
delay line 92 (i.e. runs the FIFO overwriting mem- 
ory store system 114 which serves as this delay 
line 92). At all times the CPU is providing control 
signals over the command path 33 to control op- 
eration of the auxiliary high quality digital sound 
signal source. The CPU provides control signals 
over the command path 24 for ptacing and keeping 



the fader 16 in the appropriate modes. 

Also, the CPU includes read-only memory stor- 
age containing the protocols of the start and stop 
routines and timing sequences for the operation of 

5 the entire synchronization system 40 (FIGs. 1 and 
6) including operation of the auxiliary digital sound 
storage medium, These start and stop routines and 
timing sequences in the CPU 31 are invoked by 
appropriate mechanical controls (not shown), as 

70 may be desired. 

SMOOTH TRANSITION FADER SWITCH 

/5 FIG. 4 shows the components of the smooth 

transition fader switch system 16. The ordinary 
quality sound signal connection 20 from the analog 
source feeds ordinary quality analog sound signal 
21 into a first variable gain element 96. The high 

20 quality analog sound signal 23 is fed over the 
connection 22 to a second variable gain element 
98. These two variable gain elements 96 and 98 
are identical and have respective output connec- 
tions 97 and 99 to an adder 100 whose output 

25 connection 12 feeds either the signal 21 or 23 to 
the theaters sound system. 

These variable gain elements 96 and 98 are, 
for example, volume controls ganged together and 
driven in opposing directions by a reversible drive 

30 motor 102. Control signals fed over the command 
connection 24 cause the drive motor 102 to turn for 
a predetermined increment in one direction or the 
other for increasing the volume of the appropriate 
signal 23 or 21 while simultaneously decreasing 

35 the volume of the other of these signals. 

In FIG. 5 are shown the voltage gain output 
characteristics 104 and 106 of these two variable 
gain elements 96 and 98, respectively. These gain 
characteristics are plotted versus time as normal- 

40 ized curves in FIG. 5, and thus a value of unity 
equals full gain output. For example, the interval of 
time from the time point 108 to the time point 110 
is predetermined to be one quarter of a second. 
As an example for further explaining operation 

45 of the fader 16 (FIG. 4) assume that a close se- 
quence of film splices has just been encountered 
involving missing frames whose cumulative time 
interval happens to exceed the delay time capabil- 
ity of the synchronization system 40. Consequent- 

so ly, at the time instant 108 a switch command is 
given via connection 24 for changing the sound 
signal on the stereo output connection 1 2 from the 
high quality signal 23 to the ordinary quality signal 
21, while at this time point 108 the synchronization 

55 system 40 begins operating in its "synch search" 
mode as explained previously. The crossover point 
112 of these two curves is at normalized gain of 
0.7O7. Thus, in one eighth of a second after the 

12 
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switchover command has been given, the ordinary 
sound signal 21 is the audio message effectively 
being heard by the audience. As soon as synchro- 
nism has become re-established, a command sig- 
nal given via connection 24 causes the fader sys- 
tem 16 to switch back to feed the high quality 
signal 23 to the stereo output connection 12. The 
gain characteristics 106 and 104 have the same 
shape when switching back to high quality sound, 
and so in one-eighth of second after a switch back 
command, the audio message effectively heard by 
the audience is the high quality sound. 

In order to smooth out these transitions be- 
tween high/ordinary and ordinary/high quality 
sound, an electronic adder 100 is interposed be- 
tween the variable gain output connections 97 and 
99 and the final stereo output connection 2. During 
the switchover time interval from time point 108 to 
time point 110, this adder 100 contains at the same 
time both of the audio signals 23 and 21 at their 
respective reduced levels as shown by the respec- 
tive curves 106 and 104. These curves 106 and 
104 are shaped so that their gain levels as com- 
bined at each instant by the adder 100 during 
switchover effectively maintains unity acoustical 
power level as heard by the audience. 

It is to be understood that with an appropriately 
long predetermined delay time storage capability in 
the synchronization system 40, for example in the 
presently preferred range of about 8 to 10 seconds 
as explained, then the occurrence of switching of 
the fader 16 during showing of a cinema film will 
be infrequent for standard used release prints. 

FIG. 6 shows the entire synchronization system 
40 in greater detail than FIG. 1. It is believed that 
this detailed presentation in FIG. 6 will be more 
easily understood and appreciated after consider- 
ing FIGs. 1-5 and the detailed description relating 
to those FIGURES. 

Method, system and apparatus embodying the 
present invention will now be described with refer- 
ence to FIGs. 7A and 7B for providing one or more 
translation sound tracks synchronized to a motion 
picture film, video tape or other motion picture 
source having a conventional sound track of or- 
dinary quality containing a spoken language (the 
"original language") different from the language in 
each translation sound track. 

In FIG. 7 A is seen a motion picture source 120, 
for example, a conventional motion picture projec- 
tor 122 in a theator projection room running a 
conventional cinema film 124 (for example a stan- 
dard motion picture theater release print). The film 
124 passes an optical aperture 126 for projecting 
light images 128 toward a viewing screen (not 
shown). The film also passes a sound track trans- 
ducer 130. There is a conventional sound track on 
the film 124. As described in the BACKGROUND. 



the sound track is conventionally offset along the 
length of the film 124 from the specific frames to 
which the sound track relates by an "offset dis- 
tance" equal to the length of the normal film path 
5 distance in the projector 122 between the optical 
aperture 126 and the transducer 130. This trans- 
ducer 130 provides the ordinary sound signal 21 
being fed via line 13 to the output connection 10 in 
FIG. 7B. 

io The projector 122 is arranged for remote con- 

trol, and a control interface unit 132 is connected 
through a control buss 134 with the projector for 
automatic operation. The control interface unit 132 
is connected through another control buss 136 with 

15 an auxiliary sound signal source 140 of higher 
sound quality than the ordinary sound signal 21. 
This auxiliary sound signal source 140 is a high 
quality sound playback system, such as a compact 
disc (CD) player, rotary head digital audio tape (R- 

20 DAT) player, video cassette adapter system (Sony 
model F-1 or PCM-1600 series) or a digital audio 
stationary head machine (DASH). 

This auxiliary sound signal source includes a 
prime language channel 142 containing the same 

25 audio message as the sound track on the film 
except that the prime language channel 142 is 
preferred to be of higher quality. The prime lan- 
guage channel was made from the same master 
recording as was used to make the sound track on 

30 the film. Thus, the spoken language in the prime 
language channel 142 is the same as in the sound 
track on the film 124, for example being the Eng- 
lish language. The sound signals 19 from this 
prime channel 142 are fed via line 14' to the input 

35 connection 11 in FIG. 7B. 

The correlation system 17 in FIG. 7B controls 
the interface unit 132 (FIG. 7A) through the control 
buss 33 and is controlling the digital delay line 
system 18. Consequently, the synchronism system 

40 40A in FIG. 7B serves to keep the higher quality 
(converted digital signal) sound signal 23 at the 
output 26 of the digital delay line system 18 syn- 
chronized with the ordinary sound signal 21 in the 
same manner as the synchronism system 40 de- 

45 scribed above with reference to FIGs. 1-6. 

The auxiliary sound source 140 includes trans- 
lation sound channels 144, 146. 148. each contain- 
ing another spoken language different from the 
language in the prime language channel 142. For 

so example, these other spoken languages may be 
French, German, Italian, Spanish, Chinese, Rus- 
sian, Portuguese, etc. In other words, each of these 
translation sound channels respectively comprises 
for example, two tracks for stereo French, two 

55 tracks for stero German, two tracks for stereo Ital- 
ian, and so forth. 

The prime language channel 142 may include 
two tracks for stereo English, and may include two 
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or more tracks for stereo presentation of other 
sounds including music, and two tracks may be 
included for "surround sound" for use in those 
particular theaters equipped to utilize surround 
sound. These various language channels including 5 
the prime language channel are all running in syn- 
chronization. For example, these language chan- 
nels 144, 146, 148 are running in parallel relation- 
ship with the prime channel 142. and consequently 
all of these channels are running synchronously in w 
real time. Thus, the different spoken languages and 
the other sounds, including "surround sound", are 
all available to be used for presentation to a theater 
audience desiring to hear a particular language or 
for presentation to various segments of a theater 75 
audience sitting in areas pre-assigned for respec- 
tive particular languages and equipped with appro- 
priate listening devices. The other sounds, includ- 
ing "surround sound" may be electronically added 
to the particular language so that the viewer can 20 
hear the entire intended sound track. 

It is to be understood that the translation lan- 
guage in any of the channels 144, 146, or 148 may 
be provided on a monaural track rather than being 
provided on stereo L and R tracks. The spoken 25 
language in each of the various translation lan- 
guage channels 144, 146, 148 is arranged and 
tinned in its stereo or monaural medium so that the 
lip motions of the persons seen by a viewer of the 
projected images 128. who are speaking English, 30 
for example, generally appear to correspond with 
the articulation of the translation spoken language 
to be heard by the viewer. 

The respective translation language channels 
144, 146 148 in the auxiliary sound signal source 35 
140 are connected as indicated at 14A, 14B and 
14C to the respective input ends 28A, 28B, and 
28C of the second, third, and Nth digital delay line 
systems 18A, 18B, and 18C, respectively, and thus 
the digital data for these respective spoken transla- 40 
tions are present in these respective delay line 
systems 18A, 18B and 18C. These delay lines 18A, 
18B and 18C are slaved to the prime delay line 
system 18. Consequently, the digital data for the 
spoken translations in these respective delay line 45 
systems 18A, 18B. and 18C are synchronized with 
the digital data for the prime language in the prime 
delay line 18 and thus with the ordinary sound 
signal input 21 originating from the sound track on 
the film 124. 50 

A language channel selection switch 150 en- 
ables selection of the particular spoken language 
desired to be heard while viewing the projected 
images. The analog sound signal 23A, 23B, or 23C 
available at the respective output terminals 26A, 55 
26B. or 26C includes the other sounds, music, 
"surround sound" and other sound effects along 
with the spoken translation language. Therefore, 



when the arm 155 of the channel selector switch 
150 is in the respective positions for connecting the 
contact 151, 152, 153. or 154 to the output supply 
line 22. a high quality analog sound signal 23, 23A, 
23B, or 23C containing the prime spoken language 
or a translation thereof, as may be desired, if fed 
out through the supply line 22. The signal 23 
includes the prime spoken language, say English, 
plus all of the other sounds. The signal 23A in- 
cludes the second spoken language, say French, 
plus all of the other sounds. The signal 23B in- 
cludes the third spoken language, say German, 
plus all of the other sounds. The signal 23C in- 
cludes the Nth spoken language plus all of the 
other sounds. 

In connection with the synchronization system 
40. it was explained that when there is a motion 
picture film splice involving missing picture frames, 
there is an immediate and automatic "cross fade" 
over to the lower quality sound track on the film, so 
as to continue the continuity of the sound presenta- 
tion to the audience, while a "search mode" imme- 
diately commences for re-establishing synchroniza- 
tion with the higher quality sound. As soon as 
synchronization is quickly obtained, there is an 
immediate and automatic cross fade back to the 
higher quality sound. This is very unlikely or im- 
probable occurrence, because there are 8 to 10 
seconds of storage in each delay line system 18A. 
18B, or 18C. 

If the higher quality sound being presented to 
the audience includes a translational track pre- 
sentation of a second language, then such an un- 
likely automatic cross fade to the lower quality 
track would inherently cause the audience to sud- 
denly begin hearing words being spoken in the 
prime language, which sudden change to a dif- 
ferent language might be unsettling or unattractive 
to the audience. Thus the second half of the auto- 
matic cross fade can be blanked out when a tran- 
slational track is being presented. Then, if there 
happens to be a temporary loss of synchronization 
due to a film splice with missing picture frames, 
there is a half fade (decrease in volume) into a 
brief period of silence until synchronization is 
quickly restored and then another half fade 
(increase in volume) back to the original sound 
level. 

Moreover, the central processing unit in the 
correlation system 17 may include a routine for 
keeping a record of those few instances where a 
temporary loss of synchronization occurred. Then, 
the next time that the film 124 is projected, the 
synchronization system 17 produces an automatic 
"fast dump" (a fast over-writing) of digital sound 
signal data into the front ends of the respective 
delay line systems 18. 18A, 18B, 18C. This auto- 
matic fast dump is programmed to take place at 
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about the time when the troublesome film splice 
reaches the optical aperture 126. Then, the pro- 
gram quickly causes the read address point 32 to 
jump ahead to the newly installed data near the 
front end of the delay lines resulting from the fast 
dump. Thus re-synchronization is automatically ob- 
tained by the time that the troublesome splice has 
reached the transducer 130. In other words, re- 
synchronization has automatically advantageously 
been obtained within the normal time for the offset 
sound track on the film to travel the normal dis- 
tance from projection aperture 126 to the sound 
transducer 130. 

In the event that the prime language channel 
142 in FIG. 7A includes sound channels for stereo 
sound effects, music or surround sound, then the 
bus 14', 14 may include more than 32 parallel 
communication lines, as will be understood by 
those skilled in the art. Thus, the present invention 
is not limited to the handling of two-channel stereo 
with L and R sixteen-bit parallel words. The meth- 
od, system and apparatus of this invention also can 
be applied to advantage for handling of monaural 
sound signals and also for handling multi-channel 
"surround" stereo system sound, which may in- 
volve 4-channel or 6-channel output connections 
instead of the two-channel output signal supply 
lines 20 and 22. depending upon the desired loud- 
speaker and amplifier arrangements in various the- 
aters. In other words, the embodiments of this 
invention are very flexible and broad in scope with 
respect to their adaptability to various theater or 
home viewing installations. 

FIG. 8 shows a functional block diagram, simi- 
lar to FIG. 2, of a preferred digital delay line 
system commonly called a FIFO, or first-in first-out 
overwriting memory store, for accommodating "N° 
language channels. Thus, the digital delay line sys- 
tem of FIG. 8 comprises the prime delay line 
system 18 (FIG. 2) plus the second, third, and Nth 
delay line systems 18A, 18B. and 18C. Conse- 
quently, the FIFO overwriting memory store 54 A of 
FIG. 8 handles the digital data from the prime 
language channel 142 of FIG. 7A plus the digital 
data from the translation language channels 

144,146. and 148. 

The number of parallel communication lines for 
each connection, i.e. for each buss or communica- 
tion pathway, is increased from the "32" shown for 
FIG. 2 to 32N for handling L and R digital audio 
signals each as 16-bit parallel words from the N 
language channels 142, 144, 146 and 148 in FIG. 
7A. (For those skilled in the art, the handling of 
digital signals in a parallel mode can be replaced 
by a serial mode. In this case a signal buss would 
handle N 32 bit serial words) 

The digital-to-analog converter 30A has N ana- 
log stereo outputs 26, 26A, 26B and 26C for high 



quality sound signals 23, 23A, 23B, or 23C, de- 
pending upon the particular language channel be- 
ing heard by the audience. 

The FIFO overwriting memory store 54A is now 
5 at least 480 times 32N bits as indicated for han- 
dling the various language channels 142. 144, 146 
and 148. 

As various possible embodiments of the 
present invention may be made for synchronizing a 

70 higher quality audio sound signal with another 
audio sound signal containing the same audio mes- 
sage without departing from the scope of this in- 
vention, it is to be understood that all matter set 
forth in the description and shown in the drawings 

75 is for the purpose of illustrating and teaching the 
invention and is not intended to be exhaustive of its 
many features which will be seen by those skilled 
in the art in view of this disclosure. For example, 
the ordinary sound signal source may be made 

20 from a "master recording" or a high quality du- 
plication of this "master recording". Similarly, the 
high quality digital signal source may be made 
from the "master recording" or a high quality du- 
plication of this "master recording". Thus the term 

25 "original source" or "master recording" is to be 
interpreted sufficiently broadly to include high qual- 
ity duplications thereof which contain the same 
audio message, i.e. which have essentially the 
same audio informational content. 

30 The following is a summary of the inventive 

method and system for synchronizing a digital sig- 
nal of an audio message at higher quality with 
another signal of the same audio message at lower 
quality. The illustrative embodiment of the invention 

35 synchronizes an auxiliary high quality audio digital 
sound signal source with the ordinary quality ana- 
log sound signal coming from a conventional ana- 
log sound track on motion picture film as the 
motion picture is being shown and maintains effec- 

40 tive synchronization in spite of missing segments 
of the sound track due to film splices. The method 
and system of the invention do not utilize nor 
require synchronization tracks, markers, codes, 
time codes or other extrinsic data. The standard or 

45 conventional cinema sound track is advantageously 
employed. The only requirement is that the higher 
quality audio message recording, e.g. a recording 
in a digital medium, be made from the same 
"master recording" (or a high quality duplicate 

so thereof) as the sound track so that the auxiliary 
recording have the same informational content as 
the sound track. In order to maintain synchroniza- 
tion of the high quality audio message in spite of 
missing segments of the lower quality audio mes- 

55 sage, the higher quality message is caused to 
precede the lower quality message, for example, 
by a time difference in the range from about 6 to 
about 10 seconds, and is temporarily stored in 
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time-delay means, such as a FIFO overwriting 
memory store. The synchronized high quality sig- 
nal is those portions of the temporarily stored high 
quality message which correlate with the on-going 
ordinary quality message. Correlation is achieved 5 
by re-iterative subtractions between digital num- 
bers representative of characteristics of the ab- 
solute value envelope of the ordinary quality mes- 
sage signal and digital numbers representative of 
characteristics of the absolute value envelope of w 
the high quality message. In the event that the 
missing segments of the cinema sound track hap- 
pen to amount to more than the time-delay storage 
capability of the time-delay means, the system 
automatically immediately smoothly "fades" over is 
to utilize the ordinary conventional analog sound 
track of the cinema film for continuing an uninter- 
rupted provision of the sound for accompanying 
the motion picture being viewed by the theater 
audience. Re-synchronism is quickly achieved, and 20 
the system immediately automatically smoothly 
"fades" back to the higher quality sound. In further 
embodiments of the invention, the auxiliary sound 
signal source includes one or more translation 
sound signal channels, each respective translation 25 
channel providing an audio message in a spoken 
language different from the spoken language repro- 
duced from other translation channels and also 
different from the spoken language being repro- 
duced from the conventional sound track. The 30 
audio message signals from the respective transla- 
tion channels are all synchronized with the motion 
picture by synchronization of the auxiliary record- 
ing containing the same informational content as 
the film track. Selector means enables selection of 35 
the spoken language desired to be heard by the 
viewing audience. 

Claims 40 

1. The method of synchronizing with a first 
audio signal (21) of an audio message a second 
audio signal (19) of the audio message at a higher 
quality and wherein said first audio signal was 45 
derived from a master recording, said method be- 
ing characterized by the steps of: 

causing said second audio signal (19) to be derived 
from said master recording or from a high quality 
duplicate of the master recording; and 50 
correlating (17) intrinsic characteristics of said 
audio message of said second audio signal with 
intrinsic characteristics of said audio message of 
said first audio signal for synchronizing (23) said 
second audio signal with said first audio signal 55 
(22). 

2. The method of Claim 1, characterized in 
that: said intrinsic characteristics comprise inherent 
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information regarding the audio message itself. 

3. The method of Claim 1 or 2. characterized in 
that: 

said intrinsic characteristics comprise audio pattern 
characteristics of said first and second audio sig- 
nals (21 and 19, respectively). 

4. The method of Claim 1 , 2 or 3, characterized 
in that: 

said intrinsic characteristics comprise syllabic 
structure characteristics of said audio message of 
said first and second audio signals (21 and 19), 
respectively. 

5. The method of Claim 4, characterized further 
in that: 

said syllabic structure characteristics relate to 
audio magnitude distributions occurring within syl- 
labic structures. 

6. The method of Claim 4 or 5, characterized 
further in that: 

said syllabic structure characteristics are limited to 
those occurring below a predetermined upper fre- 
quency limit which is sufficiently low to avoid im- 
posing unduly high rate requirements on the cor- 
relating. 

7. The method of Claim 2, 3, 4, 5 or 6, char- 
acterized further in that: 

said intrinsic characteristics relate to the envelopes 
of the audio message of said first and second 
audio signals (21 and 19, respectively). 

8. The method of Claim 7. characterized further 
in that: 

said intrinsic characteristics relate to the absolute 
value envelopes (no negative numbers) of the 
audio message of said first and second audio sig- 
nals (21 and 19, respectively). 

9. The method of Claim 8, characterized further 
in that: 

said absolute value envelopes are confined to less 
than a predetermined upper frequency limit. 

1 0. The method of Claim 6 or 9, characterized 
in that: 

said predetermined upper frequency limit is about 
50 Hertz. 

11. The method of any preceding Claim, char- 
acterized by: 

correlating (17) intrinsic charcteri sties of said audio 
message of said second audio signal (19) with 
intrinsic characteristics of said audio message of 
said first audio signal (21) by re-iterative subtrac- 
tions (S1 through Sn); and 

utilizing the lowest continuous differences (D1 
through On) resulting from said re-iterative substa- 
tions for determining correlation. 

12. The method of any Claims 1 through 11, 
characterized in that: 

said first audio signal (21) is an analog signal; and 
said second audio signal (19) is a digital signal. 

1 3. The method of any preceding Claim, 
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wherein said first audio signal accompanies a pre- 
sentation to a viewer of viewable image (128) in- 
volving motion to which is related said audio mes- 
sage of the first audio signal in appropriate relation- 
ship to the motion, characterized in that: 
said second audio signal (19) is synchronized with 
said first audio signal for presentation of said sec- 
ond audio message to a viewer in appropriate 
relationship to the motion involved with said viewa- 
ble images. 

14. The method of Claim 13, wherein said 
audio message of said first audio signal (21) and 
said audio message of said second audio signal 
both include the same spoken first language, char- 
acterized further by: 

providing at least a third audio signal (19A.19B or 
19C) of an audio message including a spoken 
second language being a translation of said spoken 
first language; 

causing said third audio signal to run in synchro- 
nism with said second audio signal; 
whereby synchronizing said second audio signal 
with said first audio signal also causes said third 
audio signal to be synchronized with said first 
audio signal and thereby to be in appropriate rela- 
tionship to the motion involved with said viewable 
images (1 28); and 

providing for selection of said third audio signal for 
obtaining the audio message thereof including said 
spoken second language to be presented to the 
viewer in appropriate relationship to the motion 
involved with said viewable images. 

15. The method of any preceding Claim, char- 
acterized by: 

causing the audio message of said second audio 
signal (19) to have an advance in time relative to 
the audio message of said first audio signal (21) by 
a predetermined time difference; 
temporarily storing (18, 54 or 54A) a continuously 
updated current segment of said time-advanced 
second audio signal, 

said current segment having an audio message of 
time duration at least equal to said predetermined 
time difference; and 

selectively withdrawing (26) from said current seg- 
ment those portions thereof having intrinsic char- 
acteristics correlating with intrinsic characteristics 
of said audio message of said first audio signal for 
synchronizing (23) said second audio signal with 
said first audio signal. 

16. The method of Claim 15, wherein said 
audio message of said first audio signal (21) is 
associated with viewable images (128) involving 
motion provided by operation of an audio-and-pic- 
ture medium (124) and wherein the audio message 
of the second audio signal (19) which has been 
synchronized with the first audio signal is pre- 
sented to a viewer of the images and wherein a 



discontinuity in said medium due to a missing part 
thereof may occur causing the viewable images 
and the first audio signal suddenly to appear to 
jump ahead thereby briefly causing loss of syn- 

5 chronization. characterized by: 

upon loss of synchronization due to occurrence of 
such a discontinuity immediately cross fading (16) 
from said second audio signal (23) to said first 
audio signal (21) for presenting to the viewer the 

;o audio message of the first audio signal; 

searching for those portions of said temporarily 
stored current segment of said time-advanced sec- 
ond audio signal having intrinsic characteristics 
correlating with intrinsic characteristics of the audio 

;5 message of the first audio signal now being pre- 
sented to the viewer for re-establishing synchro- 
nization; and 

cross fading back from said first audio signal to 
said second audio signal for presentation to the 
20 viewer the audio message of the second audio 
signal after synchronization has been reestablished. 

17. The method of Claim 26, characterized in 

that: 

said audio-and-picture medium (124) is a motion 
25 picture film; and 

a discontinuity in said medium is due to a film 
splice at which a part of the film as it was originally 
produced is now missing. 

18. The method of Claim 16 or 17, wherein the 
30 audio message of said first signal (21) and the 

audio message of said second signal (19) both 
include the same spoken first language, character- 
ized further by: 

providing at least a third audio signal (19A, 19B or 
35 19C) of an audio message including a spoken 
second language being a translation of said spoken 
first language; 

causing said third audio signal to run in synchro- 
nism with said second audio signal, including caus- 

40 ing the audio message of said third audio signal to 
have the same advance in time as the audio mes- 
sage of said second signal relative to the audio 
message of said first signal and temporarily storing 
(18A, 18B or 18C; 54A) a continuously updated 

45 current segment of the time-advanced third audio 
signal, said current segment of said third audio 
signal having an audio message of time duration at 
least equal to said predetermined time difference; 
whereby synchronizing said second audio signal 

so with said first audio signal also causes said third 
audio signal to be synchronized with said first 
audio signal and thereby to be in appropriate rela- 
tionship to the motion involved with said viewable 
images; and 

55 enabling selection of said third audio signal for 
obtaining the audio message thereof including said 
spoken second language for presentation to the 
viewer in appropriate relationship to the motion 

17 
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involved with said viewable images. 

19. The second of Claim 15, 16. 17 or 18, 
wherein said first audio signal (21) comprises a first 
plurality of respective channel signals for enabling 

the audio message thereof to be reproduced with 5 
at least left and right sound components and 
wherein said second audio signal (19) comprises a 
second plurality of respective channel signals for 
enabling the higher quality audio message thereof 
to be reproduced at least with left and right sound to 
components, said method being characterized by: 
adding together characteristics of said first plurality 
of respective channel signals for providing a first 
monaural signal (80) containing audio message in- 
formation from said first plurality of respective rs 
channel signals; 

adding together characteristics of said second plu- 
rality of respective channel signals for providing a 
second monaural signal (90) containing audio mes- 
sage information from said second plurality of re- ao 
spective channel signals; 

correlating (17) intrinsic characteristics of said sec- 
ond monaural signal with intrinsic characteristics of 
said first monaural signal; and 

selectively withdrawing (26) from said current seg- 25 
ment those portions thereof corresponding to por- 
tions of said second monaural signal having intrin- 
sic characteristics correlating with said intrinsic 
characteristics of said first monaural signal. 

20. The method of Claim 19, characterized by: 30 
temporarily storing (18, 54, 54A) continuously up- 
dated current segment of the respective channel 
signals of said time-advanced second audio signal; 

said continuously updated current segment having 

an audio message time length at least equal to said 35 

advance in time; 

temporarily storing (92 or 114) a continuously up- 
dated current segment of said second monaural 
signal (90); 

said continuously updated current segment of said 40 
second monaural signal exactly relating with said 
continuously updated current segment of the re- 
spective channel signals of said second audio sig- 
nal; 

selectively removing (26) from temporary storage 45 
those portions of said continuously updated seg- 
ments of the respective channel signals of said 
second audio signal having exactly relating portions 
of said second monaural signal (90) whose intrinsic 
characteristics are correlating (17) with the intrinsic 50 
charateri sties of said first monaural signal (80); and 
using the selectively removed portions for provid- 
ing the second audio signal synchronized (23) with 
said first audio signal (21). 

21. The method of Claim 19 or 20, character- ss 
ized in that: 

said first monaural signal (80) is a digital signal; 
said second monaural signal (90) is a digital signal; 



and 

intrinsic characteristics of said digital second mon- 
aural signal are correlated (17) with intrinsic char- 
acteristics of said digital first monaural signal. 

22. The method of Claim 15, 16, 17, 18. 19, 20 
or 21, characterized by: 

providing a first digital signal (80) representative of 
intrinsic characteristics of said audio message of 
said first audio signal (21); 

providing a second digital signal (90) representative 
of intrinsic characteristics of the audio message of 
said continuously updated current segment of said 
second audio signal (19); 

temporarily storing (92 or 114) said second digital 
signal; 

correlating (17) intrinsic characteristics of said sec- 
ond digital signal with intrinsic characteristics of 
said first digital signal for selectively withdrawing 
(26) from said current segment those portions 
thereof having corresponding characteristics of said 
second digital signal correlating with intrinsic char- 
acteristics of said first digital signal; and 
utilizing said withdrawn portions for providing the 
second audio signal synchronized (23) with said 
first audio signal (21 ). 

23. The method of Claim 21 or 22, character- 
ized in that: 

said first digital signal (80) includes first data re- 
garding the absolute value at uniformly spaced 
respective points in real time of the envelope of the 
audio message of said first audio signal (21); 
said second digital signal (90) includes second 
data regarding the absolute value at uniformly 
spaced selective points in time of the envelope of 
the audio message of said continuously updated 
current segment of said second audio signal (19); 
said uniformly spaced selective points in time be- 
ing spaced in audio message time by the same 
amount as said uniformly spaced respective points 
in real time; and 

correlating (17) said second data with said first data 
for determining the selective withdrawl of those 
portions of said current segment 

24. The method of Claim 23. characterized by: 
correlating (17) said second data with said first data 
by re-iterative subtractions (SI through Sn); and 
utilizing the lowest continuous differences (Dl 
through Dn) resulting from said re-iterative subtrac- 
tions for determining correlation. 

25. The method of any of Claims 15 through 
24, characterized in that: 

said predetermined time difference is at least about 
3 seconds. 

26. The method of Claim 25. characterized in 
that: 

said predetermined time difference is no more than 
about 10 seconds. 

27. The method of Claim 26, characterized in 
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that: 

said predetermined time difference is in the range 
from about 6 seconds to about 10 seconds. 

28. The method of any of Claims 15 through 
27, characterized in that: 

said first audio signal (21) is an analog signal; and 
said second audio signal (19) is a digital signal. 

29. The method of synchronizing a second 
signal (19) having an audio message at higher 
quality with a first signal (21) having said audio 
message at lower quality and wherein said first 
signal is derived from a master recording, said 
method being capable of accommodating discon- 
tinuities in said first signal due to parts thereof 
missing from what was derived from said master 
recording, such discontinuities causing said audio 
message of said first signal suddenly to jump 
ahead, said method being characterized by: 
causing said second signal (21) to be derived from 
the master recording or a high quality duplicate of 
said master recording; 

causing the higher quality audio message of the 
second signal to be advanced in time relative to 
the lower quality audio message of the first signal 
(19) by at least a predetermined interval of time; 
temporarily storing a continuously updated current 
segment of the time-advanced second signal; 
said continuously updated current segement of the 
time-advanced second signal having an audio mes- 
sage time duration at least equal to the current 
interval of time by which the higher quality audio 
message of the second signal is advanced in time 
relative to the lower quality audio message of the 
first signal; 

selectively removing from temporary storage those 
portions of said time-advanced second signal of 
which the higher quality audio message has intrin- 
sic characteristics correlating (17) with intrinsic 
characteristics of said lower quality audio message 
of said first signal; and 

using the selectively removed portions of said sec- 
ond signal for providing said second signaJ (23) 
having the audio message at higher quality syn- 
chronized with the audio message at lower quality 

of said first signal. 

30. The method of Claim 29, characterized in 

that: 

said audio message of said first signal (21) is 
associated with viewable images (128) involving 
motion; 

the audio message of the second signal (19) which 
has been synchronized with the audio message of 
the first signaJ is available for presentation to a 
viewer of said images involving motion. 

31. The method of Claim 30. characterized by: 
cross fading (16) from said second signal (23) to 
said first signal (21) upon loss of synchronization 
due to occurrence of such a discontinuity for caus- 



ing said audio message of the first signal to be 
available for presentation to a viewer of said im- 
ages depicting motion; 

searching for and selectively withdrawing (26) 
5 those portions of said current segment of said 
time-advanced and temporarily stored second sig- 
nal whereat the audio message has intrinsic char- 
acteristics correlating with intrinsic characteristics 
of the audio message of the first signal for re- 
w establishing synchronization; and 

cross fading back from said first signal to said 
second signal for the higher quality audio message 
of the second signal to be available for presenta- 
tion to a viewer of said images (128) involving 
75 motion. 

32. The method of Claim 30 or 31, wherein the 
audio message of said first signal (21) and the 
audio message of said second signal (19) both 
include the same spoken first language, character- 

20 ized further by: 

providing (144, 146 or 148) at least a third audio 
signal (19A, 19B or 19C) of an audio message 
including a spoken second language being a trans- 
lation of said spoken first language; 

25 causing said third audio signal to run in synchro- 
nism with said second audio signal, including caus- 
ing the audio message of said third audio signal to 
have the same advance in time as the audio mes- 
sage of said second signal relative to the audio 

30 message of said first signal and temporarily storing 
(18A, 18B or 18C; 54A) a continuously updated 
current segment of the time-advanced third audio 
signal, said current segment of said third audio 
signal having an audio message of time duration at 

35 least equal to said predetermined time difference; 
whereby synchronizing said second audio signal 
with said first audio signal also causes said third 
audio signal to be synchronized with said first 
audio signal and thereby to be in appropriate rela- 

40 tionship to the motion involved with said viewable 
images (128); and 

enabling said third audio signal to be selected for 
obtaining the audio message thereof including said 
spoken second language for presentation to the 
45 viewer in appropriate relationship to the motion 
involved with said viewable images. 

33. The method of Claim 29, 30. 31 or 32, 
characterized by: 

deriving a first sequence of indicia (80) indicative of 
so intrinsic characteristics of said lower quality audio 
message of said first signal (21 ); 
deriving a second sequence of indicia (90) indica- 
tive of intrinsic characteristics of said higher quality 
audio message of said second signal (19); 
55 correlating intrinsic characteristics of said portions 
of said higher quality audio message of said sec- 
ond signal with intrinsic characteristics of said low- 
er quality audio message of said first signaJ by 
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correlating (1 7) portions of said second sequence 
of indicia with said first sequence of indicia; and 
selectively removing (26) from temporary storage 
(18, 54, 54A) those portions of said time-advanced 
second signal having corresponding indicia cor- 
relating with indicia of the audio message of said 
first signal. 

34. The method of Claim 33, characterized by: 
causing said second sequence of indicia (90) to be 
advanced in time relative to the lower quality audio 
message of the first signal (21) by said predeter- 
mined interval of time; 

temporarily storing (92, 114) a continuously up- 
dated current segment of the time-advanced sec- 
ond sequence of indicia (90); and 
correlating (17) portions of said temporarily stored 
current segment of the time-advanced second se- 
quence of indicia with said first sequence of indicia 
(80) for determining those portions of said time- 
advanced second signal to be selectively removed 
(26) from temporary storage (1 8, 54, 54A). 

35. The method of Claim 33 or 34, character- 
ized in that: 

said first sequence of indicia (90) is indicative of 
syllabic structures of the lower quality audio mes- 
sage signal (21); and 

said second sequence of indicia (90) is indicative 
of syllabic structures of the higher quality audio 
message signal (19). 

36. The method of Claim 35, characterized in 

that: 

said first sequence of indicia (80) is indicative of 
syllabic structures of an absolute value envelope of 
the lower quality audio message signal (21); and 
said second sequence of indicia (90) is indicative 
of syllabic structures of an absolute value envelope 
of said higher quality audio message signal (19). 

37. The method of Claim 36, characterized in 

that: 

said first sequence of inidica (80) is indicative of 
syllabic structures of an absolute value envelope of 
said lower quality audio message signal (21 ) below 
a predetermined upper frequency limit, and 
said second sequence of indicia (90) is indicative 
of syllabic structures of an absolute value envelope 
of said high quality audio message signal (19) 
below said predetermined upper frequency limit 

38. The method of Claim 37, characterized in 

that: 

said predetermined upper frequency limit is 50 
Hertz. 

39. The method of any one of Claims 29 
through 38, characterized in that: 

said indicia of said first sequence (80) and said 
indicia of said sequence (90) involve magnitude 
values; 

said correlating (17) of portions of said second 
sequence of indicia with said first sequence of 



indica involves re-iterative subtractions (SI through 
Sn) of magnitude values; and 

the lowest differences (Dl through Dn) are used to 
determine that said portions of said second se- 
s quence of indicia are correlating with said first 
sequence of indicia. 

40. The method of any of Claims 29 through 

39, characterized in that: 

said interval of time is at least about 3 seconds. 
10 41. The method of any of Claims 29 through 

40, characterized in that: said interval of time is no 
more than about 10 seconds. 

42. The method of Claim 41, characterized in 
that said interval of time is in the range from about 

/5 6 seconds to about 10 seconds. 

43. In the showing of viewable images (128) 
involving motion and wherein the viewable images 
are provided by operation of a first medium (124) 
including first means for providing a first sound 

20 signal (21) to provide an audio message of first 
quality accompanying the viewable images and 
wherein said first means were derived from a mas- 
ter recording, the method of synchronizing with 
said first sound signal a second sound signal (19) 

25 of higher quality than said first quality but contain- 
ing the same audio message to accompany the 
showing of the viewable images, said method be- 
ing characterized by: 

providing a second medium (1 40) including second 
30 means (142) for providing said second sound sig- 
nal; 

deriving said second means from the master re- 
cording or from a high quality duplicate of the 
master recording for enabling said second means 
35 to provide said second sound signal of said higher 
quality but containing the same audio message; 
starting operation (136) of said second medium 
before commencing operation (134) of the first 
medium; 

40 thereafter simultaneously operating both said sec- 
ond medium and said first medium for simulta- 
neously providing both said second sound signal 
and said first sound signal but wherein the audio 
message of said second sound signal is preceding 

45 by a predetermined time interval the audio mes- 
sage of sad first sound signal; 
accessibly placing in temporary storage (18. 54, 
54A) a continuously updated current portion of said 
second sound signal having an audio message 

so time duration at least equal to said predetermined 
time interval; and 

continually removing from temporary storage suc- 
cessive increments of said second sound signal 
wherein the audio message is correlated (17) with 
55 the currently occurring audio message of said first 
sound signal for providing said second sound sig- 
nal synchronized (23) with said first sound signal; 
and 
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utilizing the synchronized second sound signal for 
providing the same audio message as said first 
sound signal but at a higher quality to accompany 
the showing of the viewable images. 

44. The method of Claim 43, wherein said 
audio message of said first sound signal and said 
audio message of said second sound signal both 
include the same spoken first language, character- 
ized by: 

providing further means (144, 146 or 148) for pro- 
viding at least a third sound signal (19A, 19B or 
19C) to provide an audio message including a 
spoken second language being a translation of said 
spoken first language; 

accessibly placing in temporary storage (18A, 18B 
or 18C; 54A) a continuously updated current por- 
tion of said third sound signal wherein the audio 
message corresponds with the audio message of 
the current portion in temporary storage of said 
second sound signal; 

continually removing (26A, 26B or 26C) from tem- 
porary storage successive increments of said third 
sound signal wherein the audio message corre- 
sponds with the currently removed successive in- 
crements of said second sound signal for providing 
a third sound signal (23A, 23B or 23C) synchro- 
nized with both said second and first sound signal; 
and 

utilizing the synchronized third sound signal for 
providing an audio message to accompany the 
showing of the viewable images (128) wherein the 
spoken second language is provided. 

45. A system for synchronizing with a first 
audio signal (21) of an audio message a second 
audio signal (19) of the audio message at a higher 
quality and wherein said first audio signal was 
derived from a master recording, said system be- 
ing characterized by: 

auxiliary sound signal means (140) for providing 
said second signal (19) of the audio message at 
higher quality; 

said auxiliary sound signal means having been 
derived from said master recording or from a high 
quality duplicate of said master recording; 
control means (31) for controlling said auxiliary 
sound signal means (140); and 
correlating means (17) including said control 
means for correlating intrinsic characteristics of 
said audio message of said second audio signal 
with intrinsic characteristics of said audio message 
of said first audio signal for providing said second 
audio signal (23) in synchronism with said first 
audio signal (21 ). 

46. The system of Claim 45, characterized in 
that 

said correlating means (17) includes first signal 
processing means (37, 72. 78) for said first audio 
signal and second signal processing means (84) for 



said second audio signal for correlating inherent 
information regarding the audio message itself in 
said first and second audio signals (21 and 19, 
respectively). 

5 47. The system of Claim 45 or 46, character- 

ized in that: 

said correlating means (17) correlates audio pattern 
characteristics of said first and second audio sig- 
nals (21 and 19, respectively). 
70 48. The system of Claim 45, 46 or 47, char- 

acterized in that: 

said correlating means (17) correlates syllabic 
structure characteristics of said audio message of 
said first and second audio signals (21 and 19. 
rs respectively). 

49. The system of Claim 45, 46. 47 or 48, 
characterized in that: 

said correlating means (17) includes magnitude 
comparison means (94. Sl-Sn, 86. 92 or 94. S. 86, 
20 114) for correlating audio magnitude distributions 
occurring within syllabic structures of the audio 
messages of said first and second audio signals 
(21 and 19, respectively). 

50. The system of Claim 46, characterized 
25 further in that: 

said first signal processing means (37, 72 and 78) 
and said second signal processing means (84) 
determine characteristics of syllabic structure limit- 
ed to those occurring below a predetermined upper 
30 frequency limit which is sufficiently low to avoid 
imposing unduly high rate requirements on the 
correlating means (17). 

51. The system of Claim 46, 47, 48, 49 or 50. 
characterized further in that 

35 said correlating means (17) correlates the envelope 
characteristics of the audio message of said first 
and second audio signals (21 and 19, respectively. 

52. The system of Claim 46 or 50, character- 
ized in that: 

40 said first signal processing means (37, 72 and 78) 
and said second signal processing means (84) 
determine characteristics of the absolute value en- 
velopes of the audio message of said first and 
second audio signals (21 and 19, respectively); and 

45 said correlating means (17) includes comparison 
means (94, Sl-Sn. 86. 92 or 94. S, 86, 114) for 
correlating said characteristics of the absolute val- 
ue envelopes of said first and second audio signals 
(21 and 19, respectively). 

50 53. The system of Claim 52, characterized 

further in that: 

said first signal processing means (37, 72, 78) and 
said second signal processing means (84) deter- 
mine characteristics of the absolute value enve- 
55 lopes of the audio message of said first and sec- 
ond audio signals (21 and 19. respectively) con- 
fined to less than a predetermined upper frequency 
limit 

21 
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54. The system of Claim 50 or 53. character- 
ized by: 

said predetermined upper frequency limit being 
about 50 Hertz. 

55. The system of any preceding Claim 45-54, 
characterized in that: 

said correlating means (1 7) includes storage means 
(18. 54, 54A) supplied by said auxiliary sound 
signal means (140) for temporarily storing a con- 
tinuously updated current segment of the second 
signal (21 ) having a current segment of the audio 
message of at least a predetermined time duration; 
and 

said control means causes said auxiliary sound 
signal means (140) to provide said second signal 
(19) to said storage means with the higher quality 
audio message preceding by said time duration the 
audio message of said first signal (21). 

56. The system of Claim 55, characterized in 

that: 

said correlating means (17) includes re-iterative 

■ 

magnitude indicia comparison means (SI through 
Sn). 

57. The system of Claim 56. characterized by: 
second storage means (92 or 114) for temporarily 
storing indicia of magnitude characteristics of the 
current segment of the audio message temporarily 
stored in said first-mentioned storage means (18, 
54 or 54A); and 

said re-iterative magnitude indicia comparison 
means SI through Sn are connected with said sec- 
ond storage means. 

58. The system of any of Claims 45 through 
57. characterized in that: 

said first audio signal (21 ) is an analog signal; and 
said second audio signal (19) is a digital signal. 

59. The system of any of Claims 45 through 
54, wherein said first audio signal (21) accom- 
panies a presentation of viewable image (128) in- 
volving motion to which is related said audio mes- 
sage of the first audio signal in appropriate relation- 
ship to the motion involved, characterized in that: 
said second audio signal (19) is synchronized with 
said first audio signal for presentation of said sec- 
ond audio message in appropriate relationship to 
the motion involved with said viewable images. 

60. The system of Claim 59. wherein said 
audio message of said first audio signal (21) and 
said audio message of said second audio signal 
both include the same spoken first language, char- 
acterized further in that: 

said auxiliary sound signal means provides at least 
a third audio signal (19A, 19B or 19C) of an audio 
message including a spoken second language be- 
ing a translation of said spoken first language with 
said third audio signal running in synchronism with 
said second audio signal (19), 
whereby synchronizing said second audio signal 



with said first audio signal also causes said third 
audio signal to be synchronized with said first 
audio signal and thereby for the audio message of 
said second spoken language to be in appropriate 
5 relationship to the motion involved with said viewa- 
ble images (128); and 

selection means (150) for selection of said third 
audio signal for obtaining the audio message there- 
of including said spoken second language to be 
to presented in appropriate relationship to the motion 
involved with said viewable images. 

61 . The system of claim 59 or 60, character- 
ized in that: 

said correlating means (17) includes storage means 
is (18, 54 or 54A) for temporarily storing a continu- 
ously updated current segment of at least the sec- 
ond signal (19) having a current segment of the 
audio message of at least a predetermined time 
duration; 

20 said control means (31) causes said auxiliary 
sound signal means (140) to provide said second 
signal (19) to said storage means with the higher 
quality audio message preceding by said time du- 
ration the audio message of said first signal (21); 

26 and 

said correlating means selectively withdraws from 
said storage means those portions of said current 
segment of said second signal wherein the audio 
message thereof has intrinsic characteristics cor- 
30 relating with intrinsic characteristics of said audio 
message of said first audio signal (21) for providing 
(26) said second audio signal (23) synchronized 
with said first audio signal. 

62. The system of Claim 61, characterized in 

35 that: 

said storage means (18. 18A, 18B. 18C or 54A) 
temporarily stores at least continuously updated 
current segments of the second signal (19) and the 
third signal (19A, 19B or 19C) each having a cur- 
40 rent segment of their respective audio messages 
with the same time duration. 

63. The system of Claim 61 or 62, wherein said 
audio message of said first audio signal (21) is 
associated with viewable images (128) involving 

45 motion provided by operation of an audio-and-pic- 
ture medium (124) and wherein the audio message 
of the second audio signal (19) which has been 
synchronized (23) with the first audio signal is 
presented to a viewer of the images and wherein a 

so discontinuity in said medium may occur due to a 
missing part thereof causing the viewable images 
and the first audio signal suddenly to appear to 
jump ahead thereby briefly causing loss of syn- 
chronization, characterized by: 

55 cross fading means (16); 

said control means (31) controlling said cross fad- 
ing means (16) and, upon loss of synchronization 
due to occurrence of such a discontinuity, said 
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control means immediately producing cross fading 
from said second audio signal (23) to said first 
audio signal (21) for presenting the audio message 
of the first audio signal; 

said correlating means (17) searching for those 
portions of said temporarily stored current segment 
of said second audio signal having intrinsic char- 
acteristics correlating with intrinsic characteristics 
of the audio message of the first audio signal now 
being presented for re-establishing synchronization; 
and 

said control means then producing cross fading 
back from said first audio signal to said second 
audio signal for presentation of Ihe audio message 
of the second audio signal after synchronization 
has been re-established. 

64. The system of Claim 63, characterized in 

that: 

said audio-and-picture medium (124) is a motion 
picture film; and 

a discontinuity in said medium is due to a film 
splice at which a part of the film as it was originally 
produced is now missing. 

65. The system of any of Claims 59-64, 
wherein said first audio signal (21) comprises a first 
plurality of respective channel signals for enabling 
the audio message thereof to be reproduced with 
at least left and right sound components and 
wherein said second audio signal (19) comprises a 
second plurality of respective channel signals for 
enabling the higher quality audio message thereof 
to be reproduced with at least left and right sound 
components, said system being characterized by: 
first signal processing means (37, 72. 78) for pro- 
viding a first data signal (80) containing audio mes- 
sage information from said first plurality of respec- 
tive channel signals. 

second signal processing means (84) for providing 
a second data signal (90) containing audio mes- 
sage information from said second plurality of re- 
spective channel signals; and 

said correlating means (17) correlating intrinsic 
characteristics of said second data signal with in- 
trinsic characteristics of said first data signal. 

66. The system of Claim 61, 62, 63 or 64, 
wherein: 

said first audio signal (21) comprises a first plurality 
of respective channel signals for enabling the audio 
message thereof to be reproduced with at least left 
and right sound components and wherein said sec- 
ond audio signal (19) comprises a second plurality 
of respective channel signals for enabling the high- 
er quality audio message thereof to be reproduced 
with at least left and right sound components, said 
system being characterized by: 
first signal processing means (37, 72, 78) for pro- 
viding a first data signal (80) containing audio mes- 
sage information from said first plurality of respec- 



tive channel signals; 

second signal processing means (84) for providing 
a second data signal (90) containing audio mes- 
sage information from said second plurality of re- 

5 spective channel signals; 

said correlating means (17) correlating intrinsic 
characteristics of said second data signal with in- 
trinsic characteristics of said first data signal; and 
said correlating means (17) selectively withdraws 

w from said current segment of the temporarily 
stored second signal (21) those portions thereof 
corresponding to portions of said second data sig- 
nal having intrinsic characteristics correlating with 
said intrinsic characteristics of said first data signal. 

is 67. The system of Claim 66, characterized by: 

storage means (92, 114) for temporarily storing a 
continuously updated current segment of said sec- 
ond data signal (90); 

said continuously updated temporarily stored cur- 
20 rent segment of said second data signal exactly 
relating with said continuously updated current seg- 
ment of the temporarily stored second audio signal 
(19); 

said correlating means (17) selectively removing 
25 (26) from temporary storage means (81, 54. 54A) 
those portions of said continuously updated seg- 
ment of said second second signal (21) having 
exactly relating portions of said second data signal 
(90) whose intrinsic characteristics are correlating 
30 with the intrinsic characteristics of said first data 
signal (80) for providing the second audio signal 
(23) synchronized with said first audio signal (21). 

68. The system of Claim 65, 66 or 67 char- 
acterized in that: 

35 first signal processing means (37, 72, 78) provides 
said first data signal (80) includes first data regard- 
ing the characteristics at uniformly spaced respec- 
tive points in real time of the audio message of 
said first audio signal (21 ); 

40 second signal processingmeans (84) provides said 
second data signal (90) including second data re- 
garding the characteristics at uniformly spaced 
selective points in time of the audio message of 
said continuously updated current segment of said 

45 second audio signal (19); 

said uniformly spaced selective points in time be- 
ing spaced in audio message time by the same 
amount as said uniformly spaced respective points 
in real time; and 

so said correlating means (17) correlates said second 
data with said first data for determining synchro- 
nization. 

69. The system of Claim 68. characterized in 
that: 

55 said first signal processing means (37, 72. 78) 
provides said first data indicative of syllabic struc- 
tures of the audio message of said first audio 
signaJ (21); and 
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said second signal processing means (84) provides 
said second data indicative of syllabic structures of 
the higher quality audio message of said second 
signal (19). 

70. The system of Claim 68 or 69, character- 
ized in that: 

said first signal processing means (37, 72, 78) 
provides said first data indicative of syllabic struc- 
tures of an absolute value envelope of the audio 
message of said first audio signal (21); 
said second signal processing means (84) provides 
said second data indicative of syllabic structures of 
an absolute value envelope of said audio message 
of said second audio signal (19). 

71. The system of Claim 70, characterized in 
that: 

said first signal processing means (37, 72, 78) 
provides said first data indicative of syllabic struc- 
tures of an absolute value envelope of said audio 
message of said first audio signal (21) below a 
predetermined upper frequency limit; and 
said second signal processing means (84) provides 
said second data indicative of syllabic structures of 
an absolute value envelope of said audio message 
of said second audio signal (19) below said pre- 
determined upper frequency limit. 

72. The system of Claim 71, characterized in 
that: 

said predetermined upper frequency limit is about 
50 Hertz. 

73. The system of Claim 68. 69, 70, 71 or 72, 
in that: 

said first data regards the magnitude of the audio 
message of said first audio signal (21) at uniformly 
spaced respective points in real time; 
said second data regards the magnitude of the 
audio message of said continuously updated cur- 
rent segment of said second audio signal (19) at 
uniformly spaced selective points in time of the 
latter audio message; and 

said correlating means (17) includes comparison 
means (Sl-Sn) for comparing said second data with 
said first data. 

74. The system of Claim 73, characterized in 

that: 

said comparison means (Sl-Sn) comprise re-itera- 
tive subtraction means; and 

said control means (31) includes means for deter- 
mining the lowest continuous differences (Dl 
through Dn) resulting from said re-iterative subtrac- 
tions for determining correlation. 

75. The system of any of Claims 61-74, char- 
acterized in that: 

said predetermined time duration is at least about 3 
seconds. 

76. The system of Claim 75, characterized in 
that: 

said predetermined time duration is no more than 



about 10 seconds. 

77. The system of Claim 76. characterized in 

that: 

said predetermined time difference is in the range 
5 from about 6 seconds to about 10 seconds. 

78. The system of any of Claims 45 through 
77, characterized in that: 

said frist audio signal (21) is an analog signal; and 
said second audio signal (19) is a digital signal. 
io 79. The system of any of Claims 61 through 

77, characterized in that: 

said storage means (18, 54, 54A) comprise a first 
FIFO overwriting memory store having a write ad- 
dress generator (50) and a read address generator 
75 (56); and 

said correlating means (17) controls said read ad- 
dress generator. 

80. The system of Claim 79, characterized in 

that: 

20 said storage means (92, 114) for storing a continu- 
ously updated current segment of said second data 
signal (90) comprise a second FIFO overwriting 
memory store less complex than said first FIFO 
overwriting memory store; and 

25 said second FIFO overwriting memory store is con- 
nected to said control means (31) through subtrac- 
tion means (Sl-Sn). 

81. The system of Claim 80, characterized in 

that: 

30 said second signal (19) is a digital signal; and 

selection means (42) are provided connnected to 
said second FIFO overwriting memory store select- 
ing and feeding thereto most significant bits of 
digital words of said second signal (19). 

35 82. For use with a system for providing an 

audience with viewable images (128) involving mo- 
tion, said viewable images being derived from a 
picture source (124) having an associated sound 
signal track for providing a first sound signal (21) 

40 synchronized in real time with the viewed images 
for reproducing a first audio message including a 
first spoken language synchronized in real time 
with the viewed images, apparatus comprising: 
an auxiliary sound signal source (1 40) having a first 

45 language channel (142) for providing a second 
sound signal (19) for producing a second audio 
message including said first spoken language; 
said auxiliary sound signal source also comprising 
at least one translation language channel (144. 146, 

so 148) for providing at least a third sound signal 
(19A, 19B, 19C) for producing a third audio mes- 
sage including a second spoken language different 
from and being a translation of said first spoken 
language; 

55 said translation channel running in synchronism 
with said first language channel for causing said 
third sound signal to be synchronized in real time 
with said second sound signal; and 
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said audio message of second sound signal includ- 
ing inherent characteristics which are sufficiently 
similar to inherent characteristics of said audio 
message of said first sound signal for enabling said 
second sound signal to be correlated with said first 5 
sound signal and thereby enabling said third sound 
signal to be synchronized in real time with said 
first sound signal with said third audio message 
including said second spoken language being syn- 
chronized in real time with the viewed images. w 

83. Apparatus as claimed in Claim 82, char- 
acterized by: 

selector (150) means in communication with said 
first language channel (142) and in communication 
with said second language channel; is 
said selector means also being in communication 
with sound transducer means to be heard by an 
audience viewing said images; and 
said selector means including operable control 
means (155) selectively conditionable for supplying 20 
either said second or third sound signal to said 
sound transducer means for enabling the audience 
to hear either said second or third audio message 
synchronized in real time with the viewed images. 
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© The method of synchronizing with a first audio 
signal (21) of an audio message a second audio 
signal (19) of the audio message at a higher quality 
and wherein said first audio signal was derived from 
a master recording, comprises the steps of: 
causing said second audio signal (19) to be derived 
from said master recording or from a high quality 



duplicate of the master recording; and 
correlating (17) intrinsic characteristics of said audio 
message of said second audio signal with intrinsic 
characteristics of said audio message of said first 
audio signal for synchronizing (23) said second 
audio signal with said first audio signal (21). 
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@ The method of synchronizing with a first audio 
signal (21) of an audio message a second audio 
signal (19) of the audio message at a higher quality 
and wherein said first audio signal was derived from 
a master recording, comprises the steps of: 
causing said second audio signal (19) to be derived 
from said master recording or from a high quality 



duplicate of the master recording; and 
correlating (17) intrinsic characteristics of said audio 
message of said second audio signal with intrinsic 
characteristics of said audio message of said first 
audio signal for synchronizing (23) said second 
audio signal with said first audio signal (21). 
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